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Preface 


The present book is a course on signals and circuits as it is 
taught in the USSR. This subject figures prominently among the 
fundamental disciplines essential to the expertise of communication 
engineers. Keeping pace with overall progress in science and 
technology and reflecting the current trends in component design 
and theory, this course combines and sets forth in a systematic way 
the most important principles in the field of communications. 

In his work on the text, the author has been guided by the idea 
that material should be specifically tailored to the teaching practice 
at college. This approach has governed the selection of material and 
the degree of detail in its presentation: its pages contain what, as 
the author believes, the student can fully assimilate during the time 
allotted. Specific circuit types, their study and comparative 
analysis-all this belongs to the specialized subjects in 

communication engineering. . t u f 

This text includes a wide variety of material and a wealth ol 
concepts and techniques which will come the student’s way for the 
first time. Ample space is devoted to mathematical tools of study. 
To link theory closer to practice, the chapters contain a great 
number of examples and problems giving the student deeper 
insight into the techniques of engineering analysis. 

Subject-matter and structure. The book is in two parts. Part One, 
Signals, introduces the reader to the methods currently used to 
describe and study the properties of signals. Among other things, it 
covers the classification of signals, the fundamental principle ol the 
geometric treatment of the signal space, the spectral and correlation 
analysis of deterministic signals, the theory of modulated signals, 
and the discrete presentation of band-limited continuous signals. 
The methods used to analyse and measure the characteristics ol 
random signals are discussed in detail. 

Part Two, Circuits, gives a systematic exposition of the principles 
underlying the analysis and determination of the response of linear 
and nonlinear circuits to both deterministic and random signals. 
Special emphasis is placed on the role of narrowband frequency- 
selective networks. Techniques are discussed that are used to 
synthesize linear two-terminal (one-port) and four-terminal 
(two-port) networks having a predetermined frequency response, 
and consideration is given to the passage of signals through linear 
parametric circuits. In the pages devoted to nonlinear lag-free 
(zero-memory) circuits, the reader will learn about the most 
important forms of signal transformations, such as modulation, 
detection, multiplication, and frequency conversion. Material is 
included on the theory of harmonic self-excited oscillators and the 
more recent trends that have come into being only recently in the 
wake of advances in microelectronics. These include active filters 
for analog signals and, as a most promising technique, digital signal 
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filtering. Finally, elements of the theory of optimal linear filtering as 
applied to deterministic and random signals are discussed. 

When the reader opens the book, he will undoubtedly notice its 
makeup. In addition to the text in the body of a page, its margins 
display auxiliary, supplementary and graphical material. More 
specifically, the material on the margins includes. 

1. REMINDERS referring to the previous courses, such as 
physics and circuit theory. 

2. REFERENCE DATA, such as basic physical constants, 
tabulated integrals, and the like. 

3. SHORT NOTES which have as their objective to draw the 
reader’s attention to the relation existing among various subjects, 
the methods common to communication engineering and other, 
sometimes remote, fields of pure and applied science. 

4. AUXILIARY DRAWINGS which will not, as a rule, be 
referred to in the text, but are an integral part of the study material. 
Apart from helping reduce the size of the book, they give it, as far 
as practicable, the flavour of a live lecture. 

5. LABELS to help the reader organize his work on the book: 

■ Here the text describes a principle of primary importance to 

communication theory and engineering. 

• The reader is alerted to the fact that a new concept has been 
formulated and it must be memorized. 

A The reader is advised to work a problem from among those 
given at the back of the respective chapter; the problem illustrates 
some point (or points) set forth in the body of the text. 

Today the college student has to assimilate material at a high 
pace. That is why he must schedule his academic activity carefully. 
Wishing to help him in this matter, the author has taken special 
pains to grade the material offered for assimilation and 
recapitulation optimally. Each chapter corresponds to a major topic 
of the lecture course. The basic structural unit of a chapter is 
a section roughly corresponding to a complete lecture. 

At the back of each chapter there is a SUMMARY. A firm 
knowledge of the summaries is mandatory. There are also REVIEW 
QUESTIONS which will be especially useful to the student in 
preparation for his examinations. The PROBLEMS section covers 
material for the student’s work on his own and corresponds to 
the respective chapter and the degree of complexity. Each chapter 
includes ADVANCED PROBLEMS intended for students who 
have special interest in communication theory and tend towards 
research work. 

The book is based on the lectures that the author has been 
reading at the Radio Engineering Department of the Moscow 
Power Institute. The author wishes to express his deep gratitude to 
his colleagues, especially professor G. D. Lobov and Docent 
V. P. Zhukov for their unfailing support and valuable suggestions. 

Svyatoslav I. Baskakov 














Introduction 


Communication engineering is both a science and an art whose 
objectives are: 

(1) to study the principles underlying the generation, 
amplification, emission, and reception of electromagnetic waves 
falling within the radio-frequency (r.f.) range; 

(2) to put these waves to practical use for the purposes of 
transmitting, storing and converting information. 

In its early days, after A. S. Popov invented radio in 1895, 
telecommunication was mainly based on the use of wavelengths of 
several hundred or even thousand metres. Today, the field of 
telecommunications has expanded enormously. Radio 
communications, television, radio control, radar, and radio 
navigation are only a few of the many divisions of 
telecommunications. 

The science that has to do with the physical* principles of radio 
engineering is known as radio physics. It is a division of the applied 
natural sciences, closely related to the fundamental fields such as 
quantum mechanics, solid-state physics, to name but a few. 

Communication engineering in the USSR has been pushing in 
many directions, with fundamental contributions from 
Academicians L. I. Mandelshtam, N. D. Papalexi, V. A. Fok, 
A. I. Berg, V. A. Kotelnikov, and many other Soviet scientists. 

As the reader knows from previous courses, the transmission of 
a message from the source to the recepient involves the use of 
a communication channel. Basically, a communication channel 
consists of a transmitter, a receiver, and the physical medium 
through which the emitted electromagnetic waves are propagated. 
This medium may be a free space or an engineering structure, 
such as waveguides, cables, and other transmission lines. 

The signal coming from the originator at the sending end of 
a channel is converted by a microphone, a TV camera or other 
devices into electric oscillations. These oscillations cannot be used 
to excite electromagnetic waves in the medium directly because 
their frequency is too low. Therefore, the methods of signal 
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transmission used in communication are based on the fact that the 
low-frequency, or baseband, oscillations carrying the original 
message are utilized by suitable devices to vary the parameters of 
a sufficiently strong carrier whose frequency lies in the r.f. range. 
This form of signal transformation is called the modulation of the 
carrier. 

The modulated signal is radiated by the antenna of the 
transmitter. The resultant electromagnetic waves produce in the 
antenna of a receiver a signal, usually at a very low power level. 
After frequency filtering and amplification, the received signal is 
subjected to demodulation (or detection) which is the reverse of 
modulation, in order to extract the original baseband signal from 
the modulated one. As a result, the signal appearing at the 
receiver’s output is an exact replica of the transmitted original 
message. 

From the above brief description of how a simple communication 
channel operates it is seen that the transmission of messages over 
the channel involves a variety of signal transformations. These 
transformations are implemented by appropriate physical systems 
known as (electric and electronic) circuits. Each circuit performs 
a particular transformation of the applied signal, and the nature of 
this transformation is wholly decided by the internal structure of 
the circuit. Accordingly, communication circuits are classed into 
amplifiers, frequency-selective filtering systems, waveform 
converters, modulators, detectors, and many other types considered 
in this course. 

In any real communication channel, the wanted signal is always 
accompanied by interference arising from many factors, such as the 
noise created by the chaotic thermal motion of electrons in the 
circuit components, imperfect contacts in the apparatus, the effect 
of adjacent channels operating at closely spaced carrier frequencies, 
the presence of noise-producing cosmic rays, and the like. The 
ability of a communication system to transmit and receive 
information faithfully is known as noise immunity. The development 
of noise-immune systems is one of the principal tasks of present-day 
communication engineering. The theory and art of building such 
systems are the objectives of a separate division which has come to 
be known as statistical communication based on probabilistic 
methods. One of the most effective approaches to securing high 
noise immunity is the use of better foims of signal modulation, 
notably optimal message coding. 

To sum up, the course on signals and circuits will be concerned 
with the following subjects: 

1. The properties of various signals and interference and the 
principles underlying their mathematical description. 

2. The properties of the physical systems acting as 
communication circuits. 
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3. The methods for the analysis of signal transformation in 
circuits, and for the synthesis of the basic types of circuits. 

4. The synthesis of communication circuits having predetermined 
properties. 

To-day, communication engineering is a rapidly growing and 
developing field of applied science. Speaking of its prospects in the 
nearest future, mention should be made of the tendency towards using 
electromagnetic waves at ever higher frequencies. For example, 
microwave frequencies utilized at one time solely in radar have now 
come to be widely used in television and telemetry. Impressive 
successes have been scored in the development of laser 
communication systems using carrier frequencies lying in the visible 
and infra-red regions of the electromagnetic spectrum. 

Rapid progress has been registered in the field of circuit 
components and circuit design. Whereas traditional circuits are 
almost exclusively combinations of linear and nonlinear 
components, the more recent trend is towards the use of 
self-contained functional devices and systems which effect signal 
processing by virtue of the specific wave and oscillatory phenomena 
occurring in semiconductors, dielectrics and magnetics, that is, in 
the solid state. Microelectronic hardware, too, is playing an 
important role in present-day communication engineering. Readily 
available, reliable and lag-free, integrated circuits (ICs) have had an 
important impact on many fields of communication engineering. 
Microelectronics has been instrumental in the large-scale change¬ 
over to the fundamentally new digital methods of signal processing 
and transformation. 

There is every reason to believe that all branches of 
communication will keep expanding and advancing on the basis of 
progress in many allied fields of science and technology. 


1. Signals 


Chapter 1 

Elements of the General Theory 
of Signals 

The term signal is frequently encountered not only in science and 
technology, but also in everyday life. Without giving a second 
thought to the matter, we sometimes do not differentiate the 
concepts of signal , message, and information. Ordinarily, this does 
not entail any confusion because the word signal has its origin in 
the Latin signum (sign) which has a broad range of senses. Still, in 
getting down to a systematic study of communication theory, we 
should refine the meaning of the concept of signal. By tradition, the 
term signal refers to time variations in the physical state of an 
object which serves to represent, register and transmit messages. In 
man’s activities, messages are inseparably related to the information 
they carry. 

The range of problems involving the concepts of message and 
information is very broad. They have long been drawing close 
attention from engineers, mathematicians, linguists, and philoso¬ 
phers. In the 1940s, C. Shannon laid the foundation for a new 
direction in science which has come to be known as information 
theory. 

The problems that information theory has to do with usually lie 
far outside the scope of a course on signals and circuits. Therefore, 
this book will not dwell upon the relation between the physical 
form of the signal and the meaning of the message embedded in it. 
Nor will it discuss the value of the information embodied in 
a message and, in the final analysis, in a signal. 

1.1 Classification of Signals 

When one embarks on a study of some new objects or 
phenomena, one always strives to classify them in some preliminary 
manner. At this stage, our principal objective is to formulate 
criteria under which signals may be classified, and, which is very 


Along with matter and 
field, information be¬ 
longs to the most im¬ 
portant categories of 
the natural sciences 
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Part One. Signals 


A mathematical model 


In most communica¬ 
tion systems the signals 
are carried by electro¬ 
magnetic oscillations 
and waves 


Real and complex sig¬ 
nals 


important for the subsequent discourse, to define applicable terms. 

A signal and its mathematical model. Signals as certain physical 
processes can be observed with a variety of devices and 
instruments, such as cathode-ray oscilloscopes, voltmeters, and 
receivers. This empirical approach suffers from a serious limitation. 
The phenomena examined by an experimenter always manifest 
themselves as specific, individual events which lack the degree of 
generality that could enable the experimenter to form an idea about 
their fundamental properties and to predict results under changed 
conditions. 

For signals to serve as objects of a theoretical study and 
calculations, it is essential to tell how they can be described 
mathematically or, in scientific parlance, to build a mathematical 
model of the signal under study. 

A mathematical model of a signal is a functional relation in 
which the argument (or independent variable) is time. As a rule, we 
shall designate mathematical models of signals with letters of the 
English alphabet, as follows: s(t\ u(t), f(t) 9 and so on. 

The choice of a model is the first important step towards 
a systematic study of a phenomenon (in our case, a physical signal). 
Above all, a mathematical model enables the investigator to divorce 
himself from the specific nature of the signal carrier. In 
communication engineering, one and the same mathematical model 
can equally well describe current, voltage, electric field strength, and 
other quantities. 

Another aspect of the method based on mathematical modelling 
is that the investigator can limit himself solely to those of the 
properties of signals that are objectively most important and 
neglect a large number of secondary attributes of minor 
importance. For example, it would be extremely difficult in an 
overwhelming majority of cases to find exact functional relations 
which would fit the electric oscillations as they are observed 
experimentally. Yet, proceeding from what he knows about the 
system as a whole, the investigator can draw upon the multiplicity 
of mathematical models available to him and select one best suited 
to each particular case and possessing a maximum of simplicity. 
Thus, the choice of a model is in a sense a creative process. 

The functions describing signals can take on real and complex 
values. Quite aptly, in our discussion we shall frequently mention 
real and complex models of signals. Which to use is solely a matter 
of mathematical convenience. 

Mathematical models of signals enable the investigator to 
compare them, to establish their similarity or difference, and, in the 
final analysis, to classify them. 

One-dimensional and multidimensional signals. A typical 
communication signal is the voltage across the terminals of a circuit 
or the current flowing in that circuit. Such a signal can be described 
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by one time function, so it is called a one-dimensional signal. In this 
text, we will be mostly concerned with one-dimensional signals. 
Sometimes, however, it will be convenient to consider 
multidimensional (or vector) signals of the form 

V(t) = [>i(4 v 2 {t\ ..., unM] 

formed by a set of one-dimensional signals. The number N is the 
dimensionality of a multidimensional signal. (The term 
dimensionality has been borrowed from linear algebra.) 

An example of a multidimensional signal is the set of voltages 
existing at the terminals of a multiport. 

Importantly, a multidimensional signal is an ordered set of 
one-dimensional signals. Therefore, signals differing in the sequence 
in which their components occur will not, in the general case, be 
identical: 



{%> ^ 2 } 7 ^ { V 2> V l} 


The use of multidimensional signal models is especially 
warranted in cases where a complex system is being analyzed on 
a computer. 

Deterministic and random signals. Alternatively, signals may be 
classified according as their instantaneous values can or cannot be 
predicted accurately at any instant of time. If the mathematical 
model of a signal permits this prediction, we have a deterministic 
signal. It can be specified in a variety of ways: by giving 
a mathematical formula, a computational algorithm, or simply its 
description in words. 

Strictly speaking, deterministic signals are nonexistent in nature. 
The inevitable and unpredictable interaction of the message source 
with surrounding physical* objects and the chaotic thermal fluc¬ 
tuations bring us to consider real signals as random or stochastic 
time functions, that is, to deal with random or stochastic signals. 

In telecommunications, random oscillations frequently manifest 
themselves as noise interfering with the extraction of the valid 
information from the received oscillation. That is why the search 
for ways and means of controlling interference and improving the 
noise immunity of reception are pivotal problems in present-day 
communication engineering. 

It may appear that the concept of random signal is contradictory. 
This is not so, however. For example, the signal appearing at the 
receiver output of a radio telescope trained on a source of cosmic 
radiation is composed of random fluctuations, but they carry 
variegated information about the natural object. 

No hard and fast boundary exists between deterministic and 
random signals. Quite frequently, especially when the noise level is 
substantially lower than that of the wanted signal of known form, 
a simpler deterministic model may prove adequate. 


v (t) = F 0 cos 0 v— 

a formula as a mo¬ 
del of a deterministic 
signal 
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Waveform of a typical 
random signal 










A pulse 


A video pulse and a 
radio pulse 


The term video has 
originated in radar and 
television technology 
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Fig. 1.1 Pulse signals and their characteristics: (a) video pulse; ( b ) radio 
pulse; (c) numerical parameters of a pulse 


The techniques and procedures of statistical communication 
theory developed in recent decades to analyse the properties of 
random signals have quite a number of specific features and are 
based on the mathematical tools of probability theory and the 
theory of random processes. All this will take up the whole of 
Chapters 6 and 7. 

Pulse signals. Pulses are a very important class of signals for 
telecommunications. By definition, a pulse is an oscillation which 
exists only within a finite span of time. It is customary to 
distinguish video pulses (Fig. 1.1a) and radio pulses (Fig. 1.1b). They 
differ in the following. If u v (t) is a video pulse, then the 
corresponding radio pulse will be 

u T (t) = u w {t) cos (co 0 t + cpo) 

where the frequency co 0 and the initial phase cp 0 are arbitrary. In 
the above expression, u y {t) is the envelope of the radio pulse and the 
function cos (co 0 t + cp 0 ) is called the carrier. 

Often, especially in engineering calculations, the complete 
mathematical model which accounts for all details in the “fine 
structure” of a pulse is replaced with the numerical parameters of 
the video pulse which give a simplified idea about its form. Thus, 
for a video pulse approaching a trapezoid in shape (Fig. 1.1c), it is 
convenient to know its amplitude (or height) A. Of the time 
parameters of a video pulse, its duration , x p , is the most important 
one. Frequently, it is also important to know the rise time, x r , and 
the fall (or decay) time, Xf, of a pulse. 

Communication engineering has to do with voltage pulses with 
amplitudes ranging from a few fractions of a microvolt to several 
kilovolts and with a duration of down to a few nanoseconds. 

Continuous, discrete and digital signals. Before we conclude the 
brief overview of the principles underlying the classification of 
signals, the following should be noted. 

Usually, any signal-producing physical process develops in time 
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in such a way that the signal value can be measured at any instant. 
Signals of this class are known as continuous. Another name is 
analog signals. The term analog is used since the waveform of the 
signal is analogous, or similar, to the input process waveform. 

A one-dimensional continuous signal can be represented by its 
waveform (such as recorded on an oscillograph), which may be 
likewise continuous or discontinuous. 

In the early days of communication services only continuous 
signals were used. Owing to their properties, they served well quite 
a number of tasks (radio communication, television, etc.). Also, 
continuous signals were simple to generate, receive and process by 
the facilities available at that time. 

As the requirements to be met by communication systems grew 
more stringent and the systems were called upon to perform an 
ever increasing number of tasks, the need arose to look for new 
design principles. In some cases, analog systems have given way to 
sampled-data (pulsed) systems which utilize signals produced by 
sampling. The simplest mathematical model of a sampled ( discrete ) 
signal, Sd(4 is a countable set of points {t*} (where i = 1, 2, 3, ...) 
along the time axis, at each of which a sample, s/, of the signal is 
determined. As a rule, the sampling interval, A = t t + x ^, is 
constant for a given signal. 

An advantage which discrete (sampled) signals have over 
continuous signals is that there is no need for reproducing the 
signal continuously, at every instant along the time axis. Owing to 
this feature, one and the same communication system may be used 
to transmit messages from different sources to different users by 
means of what is known as time division multiplexing (TDM). 

Obviously, in order to derive a sampled waveform from 
a continuous signal which*rapidly varies in time a shorter sampling 
interval A is required. This fundamental matter will be taken up in 
more detail in Chapter 5. 

Discrete signals include a special variety known as digital signals. 
They are called “digital” because their samples are represented by 
numbers (digits). For ease of engineering implementation and signal 
processing, binary numbers are used, with a limited and, as a rule, 
not very large number of digits or bits. Recently, there has been 
a growing trend towards using digital (sampled-data) systems on an 
ever wider scale. It has been stimulated by advances in 
microelectronics and integrated circuits. 

It is important to remember that any discrete or digital signal 
(we mean a physical process rather than its mathematical model) is 
essentially a continuous signal. For example, a slowly varying 
continuous signal, s(t), can be represented in a discrete (sampled) 
form as a sequence of rectangular video pulses of equal duration 
(Fig. 1.2a); the samples have amplitudes proportional to that of s(t) 
at sampling points. Or we may proceed in a different way: we can 



The model of a samp¬ 
led (discrete) signal 


111001011 

101110010 

010011000 

100110011 


Consecutive samples of 
a digital signal 









































20 


Part One. Signals 




Fig. 1.2 Sampling of an analog signal: (a) with samples varying in height; 
( b ) with samples varying in width (length) 


110 1 


hold the amplitude of the pulses at a constant value and vary their 
duration in proportion to the sample values (Fig. 1.2 b). 

What is important is that the two methods of converting 
a continuous signal into a sampled (discrete) signal are completely 
equivalent if we assume that the values of the continuous signal at 
the sampling points are proportional to the area of the individual 
video pulses. 

In digital form, too, samples can be represented as a sequence of 
video pulses. The binary number system ideally suits the purpose. 
We may, for example, assign a high potential level to a 1, and a low 
potential level to a 0. 

In more detail, discrete (sampled) signals and their properties will 
be studied in Chapter 15. 


1.2 Dynamic Representation of Signals 

Many tasks in telecommunications call for specific signal 
representations. Frequently it is essential to know not only the 
instantaneous (present) value of a signal, but also its behaviour 
along the time axis both in the past and in the future. 

The principle of dynamic representation. Let us describe a real 
signal approximately, using a sum of elementary signals occurring 
at consecutive instants of time. By letting the duration of the 
individual elementary signals tend to zero, we shall, naturally, have 
an exact replica of the original signal in the limit. This is the 
dynamic representation of signals; the word “dynamic” emphasizes 
the fact that the process is varying in time. 

Elementary signals may be chosen in any arbitrary manner, but 
two methods of dynamic representation are in a specially wide use. 
In one of them, elementary signals are step functions occurring at 
equal time intervals, A (Fig. 1.3a). The height of each step is equal 
to the change in the signal over the time interval A. In the other 
method, elementary signals are rectangular pulses. They are 
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Fig. 1.3 Dynamic representation of signals. (The arrows indicate the 
direction of variation in the elementary components with time.) 


contiguous to each other so that they form a sequence inscribed 
into or circumscribed around a curve (Fig. 1.3 b). 

Let us take a closer look at the properties of the elementary 
signal used in the first method of dynamic representation. 

Switching function. Suppose the mathematical model of the 

signal is a set of equalities 

( 0, t< 

v(t) =< 0.5(t/£ + 1), (1.1) 

l i, t>% 

The function (1.1) describes the transition of a physical object 
from a “zero” to a “one” state, so that the transition is linear over 
the time interval 2^. If we let £, tend to zero, then in the limit the 
transition will occur instantaneously. The mathematical model of 
this limiting signal has come to be known as the switching function 
or the Heaviside function : 

f 0 , £<0 

cr(£)={ 0.5, £ = 0 (1.2) 

[ 1 , £ > 0 

Using the function a(£), it is convenient to describe various 
switching processes in electric circuits. 

In the general case, the switching function may be translated 
from the origin of time by an amount £ 0 . The translated (or time- 
shifted) switching function is written as 

To, t<t 0 _ 

v{t-t o )=<0.5, t = t 0 ~ (1.3) 

L1, t > t 0 

The way the switching function is defined above is not the only 
one possible. As an example, which can readily be checked, the 





The switching or Hea¬ 
viside function 


Oliver Heaviside 
(1850-1925), a British 
physicist 
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functions that form the sequence 
u n {t) = 1/[1 + exp ( — ntf\ 

approximate a discontinuous signal undergoing a jump of unity at 
t = 0 ever more accurately with increasing number n. 

In communication theory, switching functions are widely used to 
describe discontinuous, notably pulse, signals. 


Example 1.1. Let there be a rectangular pulse signal v with 
a duration of 5 ps and an amplitude of 15 V. The origin of time 
coincides with the leading edge of the pulse. Write an analytical 
expression for this signal 

The jump in level at t = 0 is described by the function 
v = 15 <j(t) 

For the pulse to cease at t = 5 x 10 - 6 s, we should subtract 
a similar switching pulse delayed by this time interval so that 

v(t) = 15o(t) — 15a (t — 5 x 10 ~ 6 ) V 


V, V 


1 

i ilAH 

2.5 5.0 7.5 10 


Example 1.2. A source of an emf linearly varying with time as 
e(t) = 3.0 x 10 6 t V, is connected to an external circuit by a perfect 
switch closing at time t 0 = 2 ps. Write a mathematical model for the A 
output voltage of the system. Work Problems 1 and 

For times shorter than 2 ps, the output voltage of the source is 2 
zero. Therefore, it is obvious, that 

v(t) = 3.0 x 10 6 t x a(t — 2 x 1^" 6 )V 


vyV 



The above process may be written differently, if we represent it as 
the sum of the switching pulse occurring at the instant when the 
switch closes and a linearly rising pulse: 


v(t) = [6 + 3 x 10 6 (t — 2 x 10 ” 6 )] a(t — 2 x 10 “ 6 ) V 


Dynamic representation of an arbitrary signal in terms of 
switching functions. Consider a signal s (t\ assuming that s (t) = 0 at 
t < 0. Let {A, 2A, 3A, ...} be a sequence of time instants and {s 1? s 2 , 
s 3 , ...} be the corresponding sequence of signal values. If s o = s(0) 
is the zeroth sample value, then, as follows from the plot, the value 
of the signal at any t is approximately equal to the sum of step 
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functions 

+ -s 0 )cs{t- A) + (s 2 -s 1 )a(t-2A)+ ... 

00 

= So CT (0 + Z ( s fc - s k- 1 ) CT (t - kA) 

k= 1 

If, now, we let the sampling interval A tend to zero, the discrete 
variable kA may be replaced with a continuous variable t. The 
small changes (sk — sk-x) may be replaced by differentials ds = 
= (ds/dx)dx, and we arrive at a dynamic representation of an 
arbitrary signal in the form 


s(t) = s 0 o(t) + j (ds/dx)a(t — x)dx (1.4) 

o 


Example 1.3. The signal s(t) is equal to zero at t < 0 and varies as 
a quadratic parabola , s(t) = At 2 , at t > 0. Find the dynamic 
representation of this signal. 

Here, s 0 = 0, and ds/dx = 2 At. Therefore, 

00 

s(t) = 2A j To(t — x)dx 
o 

The meaning of the last equation is that the height of the 
elementary steps that form the aggregate signal linearly rises with 
time. 



In passing to the second method of dynamic representation of 
signals, when the expansion elements are short pulses, we 
should introduce a new important concept. 

Delta-function. Consider a rectangular pulse signal defined by the 
formula 

v(t ; i;) = (1/i;) [a (t + £/2) — u(t— £/2)] (1.5) JL 1/4 

This pulse is characterized by the fact that with any choice of the 
parameter t it has unit area: 

OO 

A v = j vdt = l 

— 00 

If, for example, v is a voltage, then A , = 1 V s. 

Now we let the parameter \ tend to zero. While contracting in __ t_ 

duration, the pulse retains its unit area. Therefore, its height must -4/2 0 4/2 

increase without bound. The limit of a sequence of such functions 
as ^->0 is termed the unit impulse function, the delta function, or the 
Dirac delta-function: 

8 (t) = limuft; 


( 1 . 6 ) 
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3(f-/o) 



The delta function in 
symbolic representa¬ 
tion 


Solve Problem 15 


The delta function is a very interesting mathematical entity. 
Being equal to zero everywhere except at the point t = 0 (it is said 
to be concentrated at that point), this function does possess a unit 
integral 


J 5 (£) dt=l (1.7) 

— 00 


From a mathematical point of view, the Dirac delta-function is 
a generalized function. At present, the thepry of generalized 
functions has gained a broad field of application. In many divisions 
of science, it has been used to study discontinuous processes that 
cannot be analysed by classical methods. 

In this course, we shall widely use the concept of the Dirac delta- 
function. The main reason for the popularity of the delta function is 
this. As will be recalled from mechanics, if a variable force F(t) acts 
on a material point of mass m over a time interval [t l9 t 2 \ the 
change in the momentum of the point will be given by 

mv 2 — mv 1 = j F(t) d t 
h 

Thus, what counts is not the force itself but its momentum appearing 
on the right-hand side of the above equation. The delta-function is 
just the mathematical model of a short input or stimulus of unit 
momentum (unit area). 

It is proved in mathematics that the properties of the delta 
function are inherent in many sequences of ordinary classical 
functions. We shall cite two typical examples [1]: 


5 ( t) = lim ]/n/2n exp ( — nt 2 /2) (1.8) 

n-+ oo 

5 (t) = lim (sin nt)/nt (1.9) 


Dynamic representation of signals in terms of delta functions. Let 
us go back to the description of a continuous signal as a sum of 
contiguous rectangular pulses (see Fig. 1.3 b). If is the kth sample 
of the signal, then the kth elementary pulse may be defined by the 
equation 

r\k(t) = Sk[p(t - tk) - o(t - tk - A)] (1.10) 

Under dynamic representation, the original signal s(t) must be 
regarded as the sum of such elementary components: 

00 

s(t)= X T u(*) 

k= - oo 


( 1 . 11 ) 


W 
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At any t other than zero, this sum will contain only one kth term 
such that 


tk < t < tk + 1 

On dividing and multiplying by the interval A, and substituting 
(1.10) into (1.11), we get 

oo 

s(t) = £ sk{t/A)[a(t-tk)-c>(t-tk-Ai]A 

k= - oo 

In the limit A -» 0, we must replace summation with integration 
with respect to the formal variable x whose differential, dx, is 
analogous to A. Since 

lim [5 (t — x) - <j(t - x — A)]/A = 8(t - x), 

A-0 

we obtain the sought-for formula for the dynamic representation of 
the signal 

s(t)= J s(x)8(f — x)dx (1.12) 

— 00 

An important property of the delta function is that its physical 
dimensions are those of frequency. 

To sum up, if we multiply a continuous function by the delta 
function and integrate the product with respect to time, the result 
will be the value of the continuous function at the point where the 
5 -impulse is concentrated. In this lies, as is customary to say, the 
filtering property of the delta function. 

Among other things, hence arises the structure of a system for 
measuring the instantanequs values of a signal s(t). The system 
must consist of two units, a multiplier and an integrator. Clearly, 
the accuracy with which the value s(t 0 ) is determined will improve 
as the real signal (say, a rectangular video pulse) approximately 
representing the delta function becomes shorter. 


The filtering properties 
of the delta function 



1.3 Geometric Methods in Signal Theory 

Many theoretical and applied problems of telecommunications 
involve questions like these: (1) In what sense may we say that one 
signal substantially exceeds another? (2) Is it possible to evaluate 
objectively how much two different signals “resemble” each other? 

In the 20th century, mathematics has developed powerful techni¬ 
ques of functional analysis which generalize our intuitive ideas 
about the geometrical structure of space. As has been found, the 
concepts of functional analysis make it possible to formulate 
a consistent signal theory based on the treatment of a signal as 
a vector in a suitably constructed infinite-dimensional space. 
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Linear signal space. Let 

M = {s!(t), s 2 (t), ...} 

be a set of signals. The reason why these objects are combined is 
that each has properties common to all elements of the set M. 

Example 1.4. M is the set of all continuous signals which are 
nonzero in the time interval [0, 15 ps] and equal to zero outside 
that interval. 

Example 1.5. M is a set of signals of the form 
Sj(t ) = Aj cos (©/ + <py) 

which are harmonic oscillations differing in amplitude, frequency and 

initial phase. _ 

The properties of the signals that form a set can be investigated if 
it is possible to establish the relationship between the individual 
members of that set. Then, as is customary to say, the set possesses 
a definite structure. The choice of a particular structure for a set is 
dictated by physical considerations. For example, in the case of 
electric signals it is known that they can be combined and 
multiplied by an arbitrary scale factor. On this basis, we may use 
for such sets a structure known as a linear space. 

For a signal set M to form a real linear space, the following 
conditions (axioms) must be satisfied: 

1. Any signal u which is an element of the set M, that is, ueM , 
The structure of a takes only real values for any t. 
linear space 2. For any ueM and veM there exists their sum 

w = u + v 

such that w also belongs to M, and the addition is both 

commutative 

u + v = v + u 

and associative 

u + (v + x) = (u + v) + x 

3. For any signal seM and any real number a, there is a signal 
which is defined as 

/ = aseM 

4. The set M contains a unique member 0 (called the origin) 
such that u + 0 = u for each ueM. 

If we consider the mathematical models of signals taking on 
complex values and assume that in axiom (3) the multiplication is 
by a complex number, we shall arrive at the concept of a complex 
linear space. 

The introduction of the linear space structure is the first step 
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towards the geometric treatment of signals. The elements of linear “ 
spaces are frequently called vectors in order to stress their analogy Vectors 
in properties with conventional three-dimensional vectors. 

The constraints imposed by the axioms are very rigorous. In no 
way can just any set of signals be a linear space. 

Example 1.6 The set M is formed by rectangular voltage video 
pulses existing in the time interval [0, 20 ps], their amplitudes not 
exceeding 10 V. May this set be taken to be a linear space? 

If we add together pulses of amplitudes 6 V and 8 V, we will 
obtain a pulse which does not exist in the set M. Hence, M does 
not form a linear space. 


The concept of a basis. As with a conventional three-dimensional 
space, a linear signal space may be given a special structure which 
plays the role of a coordinate system. It is then said that the set of 
vectors {e x , e 2 , e 3 , ...} belonging to M serves as a linearly 
independent basis for M, if the equality 

» 

£ae=0 (113) Linear independence 

i 

is satisfied only when the numerical coefficients oq vanish all at one 
and the same time. 

If we have an expansion of a signal s(t) in the form 

s(f) = Z c >' e « 

t 

then the numbers {c l5 c 2 , ...} are projections of the signal s(t) 
relative to the adopted basis. 

In signal theory, the number of basis vectors is, as a rule, 
infinitely large. Such linear spaces are called infinite-dimensional. 


Example 1.7. If a linear space is formed by signals which are 
described by polynomials of any order, however high: 

s(t)= t M" 

n = 0 

(such functions are called analytic ), then the basis for this space is 
a system of monomials 

{e 0 = l;e 1 = t; e 2 = t * 1 2 3 4 ; ...} 


A normed linear space. Signal energy. For further insight into the 
geometric treatment of signal theory, we need one more concept 
which would correspond in meaning to the length of a vector. With 
it, we cannot only give a more exact meaning to a statement such 
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as “The first signal is larger than the second one”, but also state by 
^ how much it is larger. 

. In mathematics, the analogue of a vector’s length is its norm. 

The norm of a signal ^ linear signal space Lis said to be normed, if to each vector s(t)eL 
is assigned a unique real number || s ||. This number is called the 
norm of a vector; it satisfies the following axioms of a normed 
space: 

1. The norm is non-negative, that is, || s || ^ 0, with || s || = 0 if 
and only if s = 0. 

2. For any number a the equality 

II as || = | a | • || s || 

is satisfied. 

3. If s(t) and p{t) are two vectors out of the set L, the triangle 
inequality 

\\s + p || < || s || -f || p || 
is satisfied. 

The norm of a signal may be defined in more than one way. In 
communication theory, it is most often assumed that real signals 
have the norm 


The energy of a signal 


5 = 


j s * 1 2 3 (t)dt 


(1.14) 


(of two likely values of the root, we choose the positive one). For 
complex signals 


11*1 = 


l 


SS‘ 


: d t 


(1.15) 


where s* is the complex conjugate of s. 

The square of the norm is termed the signal energy : 


If a signal represents ® 

a voltage, the units of E s = || s || = J s ( t ) d t 
signal energy are V 2 5 _ 


(1.16) 


Exactly this amount of energy will be dissipated in a 1-Q resistor if 
s(t) is the voltage applied across its terminals. 


Example 1.8. Find the energy and norm of the signal s(t) which is 
a triangular voltage pulse of height V and of duration x p . 

In the time interval [0, x p ], the signal is described by the function 

s(t)= Vt/x p 



The energy of the signal is 


0 
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E s = (F 2 /x p ) j t 2 dt = F 2 x p /3 
o 

The norm of the signal is 
II s || = ]/Es — V |/xp/ j?3 

Example 1.9. Find the energy of a radio pulse with a rectangular 

_ t_ envelope. The pulse exists on the time interval [0, x p ] and is 

p described by the function 

s(t) = K 0 cos (co 0 t + <p 0 ) 

According to Eq. (1.16), 

Xp <o 0 x p +<Po 

E s =Vl\ cos 2 (co 0 t + cpo)dt = (Fg/co 0 ) j cos 2 1 \ dr| 

0 0 

= (Eg/4© 0 ) [2(co 0 Xp+ <Po) + sin 2(co 0 x p + cp 0 )] 

If the pulse duration is many times the period of the carrier fre¬ 
quency, that is, if co 0 t p » 1, then 

E s x F 2 x p /2 

irrespective of the values of co 0 an d 90* 

It is convenient to determine the norm of a signal by Eq. (1.15) 
for the following reasons. 

1. In communication engineering it is customary to state the 
magnitude of a signal in terms of the overall power effect, for 
example, the quantity of heat dissipated in a resistor. 

2. The energy norm thus introduced is “insensitive” to variations 
in the signal waveform, which may be substantial, but occurring over 
relatively short spans of time. 

The normed linear space in which all vectors have a finite norm 
is termed the square-integrable function space and is symbolized as 
L 2 . 

Metric space. Let us introduce one more fundamental concept 
which will generalize our idea about the distance between points in 
space. 

It is customary to say that a linear space L becomes metric, if to 
each pair of elements belonging to that space, u, veL, is assigned 
a real, positive number p (u, v\ called the metric, or the distance 
between those elements. Whatever the method used to define it, the 
metric must obey the axioms of a metric space: 

1. p(w, v) = p(v, u) (reflexivity of the metric). 

2. p (n, v) = 0 for any ueL. 

3. Whatever the element weL, it is always that 

p (u, v ) < p (u, w) + p(w, v) 



These signals only 
slightly differ in energy 


The metric 
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Ordinarily, the metric is defined as the norm of the difference 
between two signals: 

p (u, v) = || u — v || (1.17) 

In turn, the norm may be construed as the distance between 
a selected element of the space and the null element or the origin: 

N|| =p (u, 0) 

By drawing upon the concept of metric, we can, for example, say 
how well one of the signals approximates the other. 


Example 1.10. The signal u(t) is a chopped sinusoid falling to zero 
at the ends of the interval [0, T]. The pulse height U is known. Find 
the amplitude A of a rectangular pulse v(t) of the same duration, such 
that the distance between the two signals is a minimum. 

The signal u(t) is defined by the formula 

u(t) = U sin (nt/T), 0 <t<T 

The square of the distance between the signals is 
T 

p 2 (u, v) = \ [U sin (nt/T) - A] 2 d t = U 2 T/2 - AAUT/n + A 2 T 
o 

A test of the above expression for an extremum shows that the 
distance will be a minimum if 



t 


A = 2I//7t s 0.637 U 
Then, 

p 2 min = U 2 T( 1/2 - 4/tt 2 ) * 0.095 U 2 T 
pmin ~ 0.308 U]/T 

▲ 

It is to be noted that the energy of the sinewave pulse is Work Problem 9 
T 

E v = U 2 J sin 2 (nt/T) dt = U 2 T/2 
o 

and its norm is 
II u II s 0.707 U]/f 

Thus, in terms of the metric we have chosen, the minimal 
attainable distance between the signals in question is 44% of the 
norm of the sinewave signal. 


1.4 The Theory of Orthogonal Signals 

Although we have introduced the linear space structure in 
a signal set, and defined the norm and the metric, we are still not 
able to find an important characteristic - the angle between two 
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vectors. This can be done, if we introduce the concept of the scalar 
product between the elements of a linear space. 

Scalar product of signals. As will be recalled, if in a conventional 
three-dimensional space we know two vectors, A and B, the square 
of the modulus of their sum is 

|A+B| 2 = |A| 2 + |B| 2 + 2(AB) (1.18) 

where 

(AB) = | A | • | B | cos v|/ 

is the scalar product of these vectors, dependent on the angle 
\|/ between them. 

By analogy, we can find the energy of the sum of two signals, 
u and v: 

Ez= J (u + v) 2 dt = E u + E v +2 j uvdt (1-19) 

- 00 - 00 

In contrast to the signals themselves, their energies are 
nonadditive-the energy of the aggregate signal contains what is 
called the cross energy # 

00 The cross energy 

E U v = 2 J uvdt 
— 00 

From comparison of Eqs. (1.18) and (1.19), we can define the 
scalar product of the signals u and v as 


(u, v)= J u(t)v(t)dt (1.20) The scalar product 


The cosine of the angle between them is 
i ( u > v ) n on 

C0S ^ = irirT~T (L21) 

II« HI»II 

A scalar product possesses the following obvious properties: 
(1) (u, u)^0; 


(2) (u, v) = (v, u ); 

(3) (Xu, v) = X(u, v), where A, is a number; (1.22) 

(4) (u + v, w) = (u, w) + (v, w). 

The linear space containing the scalar product defined in Eq. f 
(1.20) and satisfying the conditions (1.22) is called the real Hilbert jjj e Hilbert space 
space, H. 

It is proved in mathematics that the Hilbert space satisfies the 
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fundamental Cauchy-Buniakovski inequality 


I («, II wHI^Ih (1.23) 


If the signals take on complex values, we may define a complex 
Hilbert space by introducing the scalar product according to the 
equation 

00 

(«, t>)= J K(t)«*(t)d* (1.24) 

— 00 


Example 1.11. There are two exponential voltage pulses (measured 
in volts , V) translated in time relative to each other and defined as 
follows: 

v L (t) = 5exp( - 10 5 t)a(t) 

v 2 (t) = 5exp [ — 10 5 (t - 2 x 10 “ 6 )] a(t - 2 x 10 “ 6 ) 

Find the scalar product of the signals and the angle between them. 

The two signals have the same energy: 

II »1 II 2 = II V 2 II ' 2 = 25 | exp(— 2 x 10 5 t)dl 
0 

= 1.25 x 10 “ 4 V 2 s 

Their scalar product is 

00 

(^ 1 ^ 2 ) = 25 J exp ( - 10 5 t) exp [ - 10 5 (t + 2 x 10 “ 6 )] d t 
0 

= 1.023 x 10“ 4 V 2 s 
Hence, 

cos ty Vl v 2 = 0.819 
and 

^r lP 2 =35° _ 

Orthogonal signals and generalized Fourier series. Two signals, 
u and v, are called orthogonal if their scalar product and, in 
consequence, their cross energy are zero: 

00 

(u, v) = J u(t)v(t)dt =0 (1-25) 

— 00 

Figuratively speaking, orthogonal signals “do not look alike” as 
any pair of signals could. 


The principle of ortho¬ 
gonality 



David Hilbert (1862- 
1943), a prominent 
German mathemati¬ 
cian 
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Let H be a finite-energy signal Hilbert space. The signals are 
defined over a time interval [t v t 2 ~], which may be finite or infinite. 
Suppose that over the same time interval we define an infinite 
system of functions {u v u 2 , ..., u n , ...} which are pairwise mutually 
orthogonal and have unit norm: 


(UiUj) 


1 if i=j 
0 if i 7 ^ j 


(1.26) 


It is then said that an orthonormal basis is specified in the signal 
space. ® 

Let us expand an arbitrary signal s(t)eH into a series: An orthonormal basis 


00 

s(t)= Y. CiUi(t ) (!- 27 ) 

i = 1 


The representation in (1.27) is called a generalized Fourier series 
of the signal s(t) in the selected basis. 

The coefficients of this series are found as follows. We multiply 
both sides of the equality (1.27) by an arbitrary kth basis function, 
Uk and integrate the results with respect to the time interval over 
which the signals are defined: 

t 2 CO t 2 

$s(t)uk(t)dt = Xcjjfijttfcdt (1.28) 

h i =1 L 

Since the basis has the property of orthonormality, the right- 
hand side of (1.28) retains only one, kth, element of the sum. 
Therefore, 


h 

Ck = J S (t) Uk{t) d t = (s, Uk) 
h 


An algorithm for fin- 
(1.29) ding the coefficients of 
a generalized Fourier 
series 


That a signal can be represented in terms of a generalized 
Fourier series is a fundamentally important factor. Rather than 
study a functional relationship at an uncountable set of points, we 
can characterize this signal with a countable (although, generally 
speaking, infinite) system of coefficients of a generalized Fourier 
series, c&, which are projections of the vector s(t) in a Hilbert space 
onto the basis directions. 

Examples of orthonormal bases. How infinite systems of mutually 
orthogonal functions can be constructed is examined in detail in 
mathematics (see, for example, [2]). Here, we shall only give as 
examples two of the most important and commonly encountered 
cases. 


2-728 
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Signals corresponding 
to Walsh functions can 
be readily generated by 
microelectronic swit¬ 
ches 


An orthogonal set of harmonic signals. The reader can prove him¬ 
self that over the interval [0, T] a set of trigonometric functions of 
multiple frequencies, extended to include a time-invariant signal: 

u 0 = l/j/r 

u t = ]/2/T sin 2nt/T 

u 2 = j/^/Tcos 2nt/T 


u 2 m -1 = l/2/ T sin 2nmt/T 
u 2 m = l/ 2 /Tcos 2nmt/T 


constitutes an orthonormal basis. 

The expansion of periodic functions into a series in terms of the 
above basis will be taken up in the next chapter. 

Walsh functions. In recent time, advances in the processing of 
discrete signals have given impetus to the use of orthonormal 
Walsh functions. A distinction of these functions is that over the 
interval of their existence, [ - T/2, 7/2], they take on only two 
values (+ 1 and — 1) which, as is seen, differ solely in sign. 

Let us introduce a dimensionless time 0 = t/T and designate the 
kth Walsh function by the symbol wal (k, 9). These functions are far 
more difficult to specify analytically (see Appendix 1). The basic 
idea, however, can readily be gleaned from Fig. 1.4 which shows 
plots of the first few Walsh functions. 

Interestingly, the kth Walsh function has the number k of zero 
crossings (sign changes) over the existence interval. 



wal( 0 ,d) 


, , 3 

V 2 ' 

0 l / 2 

wal ( 1 , 9 ) 


, » 

- V 2 

o Vi 



Fig. 1.4 Plots of the first few Walsh functions 
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Obviously, the condition of normality for Walsh functions for 
any value of k is ^ 

1/2 Solve Problem 11 

|| wal (k, 9)|| 2 = J wal 2 (k, 9)dS=l 
-1/2 

The orthogonality of these functions is assured by the principle of 
construction and can be verified directly. For example, 

1/2 -1/4 

j wal(l, 9) wal (2, 9)d9 = J (— l) 2 d9 

-1/2 -1/2 

0 1/4 1/2 

+ J (-l)xld9 + j l 2 d9 + j lx(-l)d9 = 0 

-1/4 0 1/4 

The expansion of a finite-energy signal defined over the time 
interval [— 7/2, 7/2] into a generalized Fourier series in terms of 
Walsh functions, has the form 

00 

s(9) = £ Cfcwal(fe, 9); 9 = t/T (1.31) 

k = 0 


Example 1.12. Find the first two coefficients in the expansion of 
a triangular pulse in terms of Walsh functions. 

Over the time interval [ — 7/2, 7/2], the signal is described by 
a function of the form 



s(t)=U(t/T+ 1/2) 

The coefficients of the generalized Fourier series are: 
1/2 1/2 

c 0 = J s(9)wal(0, 9)d9=l7 j ‘ (» + 1/2)dO = U/2 
- 1/2 - 1/2 

1/2 

Cl = j 5(9)wal (1, 9)d0 

- 1/2 



0 1/2 

= - U J (9 + 1/2) dO + U j (9 + 1/2) do = U /4 
- 1/2 0 

Thus, when a triangular pulse is approximated by the first two 
members of a Walsh function series, the result is a step function. 
Interestingly, even this rough approximation is satisfactory from the 
view-point of the energy norm introduced earlier. To demonstrate, 

1/2 

E S =U 2 j (9 + l/2) 2 d0 = U 2 /3 
- 1/2 


2 * 
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whereas the difference energy 

1/4 TJ 2 

II 5 ($) - C 0 wal(0, 0) — wal(l, $)\\ 2 = 4U 2 f ^ 2 d^ =- 

o 3 x 16 

is only one-sixteenth, or 6.25%, of the energy of the signal being 
approximated. 


The energy of a signal represented by a generalized Fourier 
series. Consider a signal s(t) expanded into a series in terms of 
orthonormal basis functions: 

00 

S(t)= £ c kUk(t) 
k= 1 

and determine its energy: 

t 2 t 2 00 00 

Es = J s dt = j Y Y (dCj)uiUjdt 

1 1 t 1 i = l j= l 

00 00 f 2 

= I Z (Ci'Cj) } UiUjdt (1.32) 

t=lj=l t x 


Because the basis functions are orthonormal, only those terms in 
the sum of (1.32) are non-zero for which i = j. To sum up, we have 
obtained a remarkable result: 

This equation genera- 

lizes Pythagoras’theo- F = y r z n _ 

rem to an infinite- 5 f “i 1 (1.33) 

dimensional space 


The meaning of the above expression is this: The energy of 
a signal is equal to the sum of the energies of all the components 
that make up the generalized Fourier series. 

Optimality of the signal expansion in terms of orthogonal basis 
functions. Let there be a signal, s(t), for which we introduce 
a finite-dimensional approximation 

N 

s{t)= £ CkUk(t) 

k= 1 

with unknown coefficients ck, and require that these coefficients be 
chosen such that the approximation error has a minimum energy: 

h 

H=||s-s|| 2 = | [s- Y J CkUk] 2 dt= min (1.34) 

h k 

The necessary minimum condition consists in that the coefficients 
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c m must satisfy a set of linear equations 

d[i/dc m = 0, m = 1, 2, N (1.35) 

In the expanded form, the approximation error is 
t2 N n N 

g = J [s 2 - 2s £ ckUk + Z I CiCjUiUj ] dt 

ti k= 1 i= 1 j= 1 

Since the basis functions involved are orthogonal, it follows that 

d ll 

~~z -(J [Cm ui - 2 SCm M m ] dt) = 0 

OCm t x 

In view of the fact that the basis functions have a norm of unity, 
we may conclude that equalities (1.35) will be satisfied when the 
expansion coefficients are chosen such that 

h 

c m = I s(t)u m (t)dt 
h 

which fully checks with Eq. (1.29) for the coefficients of 
a generalized Fourier series. 

A more thorough analysis (when one considers not only the first, 
but also the second derivative of the error energy) will show that 
the expansion of a signal into a generalized Fourier series assures 
a minimum of the approximation error. 

It is to be noted in conclusion that, by definition , the Hilbert 
signal space possesses the important property of completeness which 
consists in the following.’ If the limit of the sum 

N 

s(t) = lim Yj c i u i(t) 

N->cc i= i 

exists, then the limit itself is always an element of the Hilbert space. 
An important property of this class of spaces is that the norm of 
the approximation error is a monotonically decreasing function of 
N, the number of expansion terms considered. By choosing 
N sufficiently large, it is always possible to minimize the error to 
any acceptably small value. 

Implementation of orthogonal signal expansion. Turn to the 
block diagram of Fig. 1.5 which shows a set-up used to determine 
experimentally the expansion coefficients for an arbitrary signal 
expanded into a generalized Fourier series in terms of a specified 
set of orthonormal basis functions. 

The key elements of the set-up are function generators which 
generate the basis functions in terms of which the expansion is 
carried out. The signal in question is simultaneously fed to an 
assemblage of multipliers each of which multiplies the applied 


The completeness of 
space 
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Fig. 1.5 Block diagram of a signal analyzer 

signal by an appropriate basis function. From the multiplier out¬ 
puts, the resultant signals are applied to integrators. 

With this form of signal processing, a time-invariant signal 
appears across the output of each multiplier at the end of the 
integration time. The magnitude of the output signal is, in accord 
with Eq. (1.29), exactly equal to a particular coefficient of the 
generalized Fourier series. 

Clearly, the performance of the set-up as a whole depends on 
how accurately the basis functions can be reproduced and also on 
how well the multipliers and the integrators operate. 

The set-up shown in Fig. 1.5 is important not only in an applied 
but also in a theoretical sense. From its analysis we can see that all 
of the information embedded in the signal can be represented as 
a set of numbers, although infinite, but yet countable. 


Summary 

For a theoretical study of signals, it is necessary to build their mathematical models. 
Signals are classified on the basis of the significant attributes of the corresponding 
mathematical models. It is customary to class signals into one-dimensional and multi¬ 
dimensional, deterministic and random, continuous and discrete. There is a special 
variety of discrete signals, called digital signals. 

<0$* In dynamic representation, signals can be described, taking into account their behavi¬ 
our both in the “past” and in the “future”. 

'QC* Dynamic representation utilizes two elementary signals, one being the switching 
function and the other, the Dirac delta-function. 

^*0* By introducing appropriate structures, some sets of signals can be transformed into 
linear functional spaces. 
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33* A system of linearly independent vectors forms a basis in terms of which an arbitrary 
element belonging to a linear space can be expanded. 

In a linear signal space, the analogue of the length of a vector is its norm. The square 
of the norm is called the energy of the signal. 

A linear signal space turns into a metric space if one can determine the distance 
(metric) between two vectors. 

3"C> In order to determine the angle between two elements of a linear space, resort is made 
to their scalar product proportional to the cross energy of the signals. If the scalar 
product is zero, the signals are called orthogonal. 

00 The representation of a signal as an expansion in terms of an orthonormal basis set is 
termed a generalized Fourier series. The coefficients of this series are equal to the 
scalar products of the signal being expanded and the corresponding basis vectors. 

00 The most important examples of orthonormal basis sets are harmonic functions at 
multiple frequencies and Walsh functions. 

00 The energy of a signal is equal to the sum of all the components that form the 
generalized Fourier series. 

00 The expansion of a signal in terms of orthonormal basis functions yields a minimal 
r.m.s. error of approximation. 

00 The extraction of useful information from a signal may be visualized as an 
experimental evaluation of the generalized Fourier series coefficients of that signal. 


Review Questions 

1. Name two or three examples of physical processes describable with stochastic 
mathematical models. 

2. Name the characteristics used to describe pulse signals. 

3. Define the difference between a video pulse and a radio pulse. 

4. Under what conditions will the replacement of a continuous signal with a discrete signal 
be inadequate? 

5. Formulate the principle of dynamic signal representation. 

6 . List the main properties of the delta function. 

7. State the most important axioms of a linear space. 

8 . What is the physical meaning of the square of the signal norm? 

9. What is the geometric meaning of the Cauchy-Buniakovski inequality? 

10. Draw several plots illustrating orthogonal signals. 

11. What is the Hilbert space? 

12. What makes the expansion of signals in terms of orthogonal Walsh functions 
convenient? 
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Problems 


1. The figure shows a triangular voltage 
pulse. 



Write a mathematical model for this signal, 
using a combination of switching functions. 

2. Solve Problem 1 for a symmetrical 
triangular pulse. 



3. Write a mathematical model for an 
infinite sequence of identical triangular 
pulses. 



4. Using Eq. (1.4), find a dynamic 

representation for the exponential video 
pulse described by the formula: 

u{t)= (7exp(- at)G(t) 

5. Using Eq. (1.4), find a dynamic 

representation for the Gaussian video pulse 

u(t)= U ex p(— fit 2 ) 

defined along the entire infinite time axis. 


Note the way in which Eq. (1.4) must be 
modified. 

6. Show that the delta-function can be 
construed as the derivative of the switching 
function 

5 (t) = da/d t 

Hint. Take the derivative of the function 
v(^, t) represented by Eq. (1.1), and pass to 
the limit with ^->0. 

7. Find the energy and norm of the signal 
described by a mathematical model of the 
form 

u(t)= l/ 0 exp(-a| t\) 

8. Find the energy and norm of the 
cosinusoidal pulse 

r 0, (O 0 t < - tc/2 

s(t )=< U cos co 0 t, - 7i/2 < co 0 t < tu/2 

0, co 0 t > rc/2 

9. The signal u(t) is a symmetrical 
triangular pulse; the signal v(t) is 
a rectangular pulse inscribed in the first. 



Find the amplitude of the rectangular pulse 
such that the distance between the two 
pulses is a minimum. 

10. Using the principle of orthogonality, 
construct a plot of the function wal (4, 0) on 
the basis of Fig. 1.4. 

11. Show that the distances between any 
two functions out of the set wal (0, 0), wal 
(1, 0) and wal (2, 0) are the same and equal 
to |/2. 

12. Apply a similar analysis to an 
orthonormal set of trigonometric functions 
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(see Eq. (1.30)). Compare the results. Is it 
possible to draw an analogy with Py¬ 
thagoras’ theorem? 

Advanced Problems 

13. An experiment has yielded the 
following oscillogram of a signal: 

V', V 



C = 2 nF. Pulse duration is x p = 0.5 ps, and 
pulse amplitude is to = 12 V. 



Prove that the real pulse can in this case 
be replaced with a mathematical model of 
the form Ad(t). What should the coefficient 
A be in this case? 

List several simple physical situations out 
of everyday practice, when the actual effect 
on a system may be approximated with 
a delta-impulse. 

16. Prove that the delta-function may be 
treated as the limit 


It is hypothesized that the signal can be 
described by an exponential time function. 
Propose the simplest possible graphical 
method to test this hypothesis. 

14. Propose a mathematical model for the 
following signal: 



15. A series resonant circuit is driven by 
a source of pulsed emf. The system’s 
parameters are: R=5Q, L= 10 pH, and 


5 ( t ) = lim 


1 sin qt 


17. Generalize the concepts of energy and 
norm to vector signals of an arbitrary 
dimensionality N. 

18. Prove that if H is a real Hilbert space 
containing the signals u and v, the 
parallelogram equality is valid: 

|| u + || 2 + || m — r || 2 = 21| m || 2 + 21| r || 2 

19. Prove that the identity 

4 (u, v)=\\u+v\\ 2 -\\u-v\\ 2 +j\\u 
+jv \\ 2 ~j\\u-jv || 2 

holds in a complex Hilbert space. 

20. Let {Uk(t), k= 1, 2, ...} be an 
orthonormal basis in a Hilbert space H. 
Prove that Parseval’s theorem 

00 

(Sv S 2 )= X ( s l- U k)( s 2> Uk) 
k = 1 


holds for any s lf s 2 eH. 









































































































Chapter 2 



Spectral Representations 
of Signals 


Of the many sets of orthogonal functions that can be used as 
basic ones in the representation of communication signals, a special 
place is occupied by harmonic (sine and cosine) functions. 
Harmonic signals are important for communication applications 
due to several reasons. Among other things, harmonic signals are 
invariant under the transformations effected by linear stationary 
electric circuits. If the input to a linear circuit is a harmonic 
oscillation, the output from that circuit will likewise be a harmonic 
oscillation differing from the original one solely in amplitude and 
initial phase. Also, harmonic signals are relatively simple to 
generate. 

If a signal is represented as the sum of harmonic oscillations 
differing in frequency, the signal is said to have been resolved into 
its spectrum in terms of harmonic functions. The sum of the 
individual harmonic components of the signal forms its spectrum. 

2.1 Periodic Signals and Fourier Series 



V 




V 

t 

r 

r 

r 

V 



Examples of periodic 
signals 


The mathematical model of a process cyclically repeating itself in 
time is a periodic signal, s(t), such that 

s(t) = s(t-\- nT) n = ± 1, ±2,... (2.1) 

where T is the period of the signal. 

The spectral representation of a signal can be obtained by using 
the expansion into a Fourier series. 

The Fourier series. Let us define over the time interval [ — T/ 2, 
T/ 2] the orthonormal basis (already discussed in the previous 
chapter) which is formed by harmonic functions with multiple 
frequencies: 

u 0 = vVt 

tq = j/2/T sin 2nt/T 
u 2 = |/2 /T cos 2nt/T 
u 3 = |/2 /T sin 4nt/T 
u 4 = j/2/T cos nt/T 


( 2 . 2 ) 
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Any function u m out of this basis satisfies the condition of 
periodicity, Eq. (2.1). On expanding the signal s(t) in terms of this 
basis, that is, on finding the coefficients 

Cm = (s, U m ) (2.3) 

we get its spectral representation 

00 

sit)^ X (2-4) 

m — 0 

The expansion is valid along the entire infinite time axis. The series 
of the form in (2.4) is called the Fourier series. # 

Let oq = 2n/T be the fundamental frequency of the sequence that The fundamental fre- 
forms the periodic signal. When finding the expansion coefficients quency 
by Eq. (2.3), the Fourier series for a periodic signal may be written 
in the form 


00 

s(t) = a 0 /2+ Y, (flncosnceqt + b n sinn(0 1 t) (2.5) 

n = 1 


where the coefficients are 
2 772 

a 0 = — J s(t)dt 

1 -T/2 

2 772 

a n = — j s(t)cosnco 1 tdt (2.6) 

T -T/2 


'2 T ' 2 

b n = — j s(t)sin rcccqf dt 
T -T/2 

Thus, in the general case a periodic signal contains 
a time-independent constant component and an infinite set of 
harmonics at frequencies (O n = n(O l9 n = 1,2,3,..., which are 
multiples of the fundamental frequency of the sequence. 

Any harmonic in a Fourier series is characterized by its 
amplitude A n and its initial phase <p„. To show this, the expansion 
coefficients should be written as follows: 


e 

Harmonics 


an — A n cos (f)fl 
b n = A„sincp w 

so that 

An — | /a n b n 

and 


cp„= arc tan (bja n ) 

Substituting the above expressions into Eq. (2.5) yields an 
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equivalent form of the Fourier series 

oo 

s(t) = a 0 /2 + X A„ cos (nmjt - (p„) (2.7) 

n= 1 

which is sometimes more convenient to use. 

The spectral diagram of a periodic signal. This term applies to 
a plot of the Fourier coefficients for a specific signal. It is usual to 
distinguish an amplitude diagram and a phase diagram (Fig. 2.1). 
The numbers laid off as abscissae are the discrete harmonic 
frequencies. 



Fig. 2.1 Spectral diagrams of a periodic signal: (a) amplitude; ( b ) phase 

Of the two, the amplitude diagram is more frequently used as it 
Solve Problems 1 and 2 contains information from which we can determine the percentage 
of a particular harmonic in the spectrum of the entire periodic 
signal. 


Example 2.1. The Fourier series of a periodic train of rectangular 
video pulses of known parameters (t, T, A), which is even about the 
point t — 0. 

In communication engineering, use is made of the ratio 
q — T/t 

which may be called the reciprocal pulse duty factor*. Using Eqs. 
(2.6), we get 

«o/ 2 = A/q 

2A T / 2 2A 

a n = —— f cosn(n 1 tdt = - sin (rccOii/2) 

T -x /2 nn 

This leads us to a Fourier series of the form 


s(t) = (A/q) 


1 + 2 


I- 


sin ( nn/q ) 


nn/q 


cos n C 0 i t 


( 2 . 8 ) 


The pulse duty factor 


* In the UK and US literature on the subject, use is made of t/T, called 
the pulse duty factor-Translator’s note. 
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Fig. 2.2 Amplitude spectrum of a periodic sequence of rectangular video 
pulses: (a) for a large pulse period to pulse duration ratio; ( b ) for a small 
pulse period to pulse duration ratio 



$ 

The cut-off angle 


The typical amplitude diagrams of the sequence in question for 
two limiting cases are shown in Fig. 2.2. 

It is important to note that a sequence of short pulses recurring 
at widely spaced intervals (q» 1) has a spectrum rich in harmonics. 

The spectral diagram of the above form is said to have a lobed 
structure. 

Example 2.2. The Fourier series of a periodic pulse sequence 
formed by a harmonic signal of the form U m coscon limited at U 0 (it 
is assumed that \ U 0 \ <U m ). 

A special parameter, the cut-off angle, 0, is used to describe such 
a signal. It can be deduced from the relation 

U m cos 0 = U 0 

Hence, 0 = arc cos (U 0 /L/ m ). Then the quantity 20 will be the 
duration of one pulse in electrical degrees.* 

Analytically, the pulse repeated in the sequence can be written as 

s ( t ) = U m cos ceq t — U 0 , — 0 < t < 0 

The constant term of the sequence is 

| 3/g>i 

«o/2 = — J (l/ m cosco 1 t- U 0 )dt 

* -3/coi 

1 9 u 

= -— j (L^cosoqt - U 0 )d(co 1 t) = —^-(sinO — OcosO) 


The amplitude coefficient of the fundamental harmonic is 
1 * 

a 1 = —— f (UmCOSG)^ — U 0 )cosco 1 td(co 1 t) 

2n 


= (U m /n) (0 — sin 0 cos 0) 


* In the UK literature on the subject this quantity is called the angle of 
current flow. In the US literature, it is known as the operating angle. 
-Translator’s note. 
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The amplitude coefficients a n of the 2nd, 3rd and higher 
harmonics (n = 2, 3, ...) are found in a similar way: 

sin n $ cos $ — n cos 72$ sin 0 
a n = (21/ w/tt) 7 2 

22(22 — 1) 

The result thus obtained is usually written as 
a 0 /2 = U mYo (&) 

~ U m Yn(^) 

where y 0 , y l5 y 2 , ... are Berg functions: 

To ($) = (! /^) (sin $ — 0 cos $) 

yi (0) = (1 /n) (0 — sin 3 cos $) (2.9) 


Yn(9) = (2 /tc)- 

for n = 2, 3, .... 


sin cos $ — 2i cos 22$ sin $ 


72 ( 72 2 — 1 ) 



0 45 90 135 180 


Fig. 2.3 Plots of the first few Berg functions 


A. I. Berg (1893- 
1979), a leading So¬ 
viet scientist in the 
field of telecommuni¬ 
cations 


Plots of the functions y 0 , y l5 and y 2 are shown in Fig. 2.3. 
Since these functions are frequently used in engineering 
calculations, they are tabulated in an appendix to this book along 
with a computer subroutine in FORTRAN. 


The complex form of the Fourier series. The principal formula 
(2.5) of Fourier analysis as applied to periodic signals can be given 
an elegant form, if we represent harmonic functions as a sum of 
exponentials with imaginary exponents. By applying Euler’s for¬ 
mulas, we can re-write the series (2.5) as 

00 / e jn(Q 1 t_ -jruQxtK 

s(t) = aJ2 + Yj [ a n - 2 -•" - — -J (2.10) 
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Instead of a n and b n , we introduce new coefficients 
Cn = ( a n ~jbn)/2 

f or n = 1, 2, 3, .... We may as well determine the coefficients C n for 
negative indices 22, such that 

C — n = ( a n F jb n )/2 = Cn 

because the coefficients a n are even, and the coefficients b n are odd 
with respect to the indices. Thus, the summation in (2.10) may be 
extended to include all values of 22, both positive and negative: 


00 

s(t)= X C„exp0>i0)jt) (2.11) 

n = — 00 


Equation (2.11) is the Fourier series in complex form. As can be 
readily seen, the complex coefficients are given by 


1 t/2 

C n = — j s (t) exp (- jrm 1 t)dt (2.12) 

T - T/2 


The concept of negative frequencies. Since it is symmetrical about 
the origin of frequencies, the spectral diagram of a periodic signal 
in the form given by (2.11) contains components on the negative 
half-axis. 

A few remarks are in order with regard to the concept of 
negative frequency. Consider the identity 

cos co x t =- 

1 o 


In the method of complex amplitudes, the term (1/2) exp is 

represented on a complex plane as a phasor of length 1/2, which 
rotates at angular velocity (iq in the direction of increasing polar 
angle cot. The phasor corresponding to the term (l/2)exp(-jaqt) 
differs in that it rotates in the opposite direction. On combining, 
these two complex numbers yield a real number. 

In the series of Eq. (2.11), the terms with positive and negative 
frequencies form pairs. For example, 

Cn exp (72200! t) + C- n exp( — jn(o 1 t) = \C n \exp [j(n(D 1 t + cp n )] 



+ |C„|exp[ — j(ruo 1 t + cp n )] = 21 C n 1005(2200! t + cp n ) 


To sum up, a negative frequency is not a physical, but 
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S 


a mathematical concept associated with the manner in which 
complex numbers are represented. 

Representation of a periodic signal on a complex plane. The 

structure of the Fourier series in Eq. (2.11) is such that a periodic 
signal can be represented by an infinite sum of phasors rotating in 
a complex plane (Fig. 2.4). 

The construction involved is carried out as follows. From the 
origin (point 0), we draw a real phasor C 0 on the complex plane. 
This phasor represents the term whose number is n = 0 Then, 
in Eq. (2.11) we set t equal to zero and construct a sum of pha¬ 
sors 

C + = C 1 + C 2 + C 3 + ... 

C- = C-1 + C_2 + C_3 + ... 

answering the contributions made by the positive-frequency and 
negative-frequency terms. For a converging Fourier series, each of 
the sums is represented by a phasor of finite length. 




Fig. 2.4 Graphic representation of a Fourier series in complex form 

As already noted, the coefficients of a Fourier series for positive 
and negative frequencies are complex conjugate. Therefore the 
C+ + C_ phasor is always real. When it is combined with the 
constant term C 0 , it forms a phasor whose length, 5(0), is equal to 
the instantaneous value of the signal at the initial instant of time, 
t 0 • 

Then the picture is transformed: the phasors C 1 ,C 2 ,... for 
positive frequencies rotate at angular velocities ccq, 2(d 19 ... up in 
phase angle, whereas the phasors C_ 1? C_ 2 , ... rotate in the 
opposite direction. The tip of the resultant phasor gives the current 
value of the signal. 

The pictorial representation we have just examined is very helpful 
sometimes. We shall use it in the next section. 
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2.2 Spectral Analysis of Nonperiodic Signals. 
The Fourier Transform 


Fourier analysis permits an in-depth and fruitful generalization 
with which we can readily obtain spectral characteristics for 
nonperiodic signals. Those of special interest to communication 
engineering are signals in the form of single pulses. 

Periodic continuation of a pulse. Let s(t) be a pulse signal of 
finite duration. If we mentally add to it similar signals recurring 
with period T, we shall obtain the already familiar periodic 
sequence, Sp Qr (t), which can be represented as a complex Fourier 
series 

00 

sper(0= Z C n exp(jn( 0 1 1) (2.13) 

n=- oo 

with the complex coefficients given by the integrals 
1 772 

C n = — I Sper(f) exp (— jnca^t) dt (2.14) 

1 -T/2 

In order to go back to a single pulse signal, we should let the 
period T tend to infinity. Then, 

(1) The frequencies of adjacent harmonics, nco 1 and (n+ljocq, 
will be as close as we may wish, so that in Eqs. (2.13) and (2.14) we 
may replace the discrete variable ruo 1 with a continuous variable co, 
which is the current frequency. 

(2) The amplitude coefficients C n decrease without bound because 
the period T appears in the denominator of Eq. (2.14). 

Our objective is to find the limiting form for Eq. (2.13) with T 
tending to infinity. 

The concept of the spectrum of a signal. Let us take advantage of 
the fact that the coefficients of a Fourier series form complex 
conjugate pairs 

C n = A n QXp(j(p n ) 

C- n = A n exp(-j(p n ) 

Each pair represents a harmonic oscillation 
A n exp [j (nco 1 1 + cp„)] + A n exp [ -7(^1 1 + <p„)] 

= 2 A n cos (naqt + cp n ) 

with a complex amplitude 
2An exp (/<Pn) = 2C n 

Consider a small interval of physical frequencies, Aco, in the 


A single pulse 



A periodic sequence 
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In physics, it is usually 
said that signals are 
combined coherently 


neighbourhood of some frequency co 0 . The number of spectral 
components contained within that interval is given by 

N = Aco/oq = AcoT/2tt 

Since their frequencies differ by an amount which may be made as 
small as we like, we may combine them as if they were of the same 
frequency and had the same complex amplitude 

2 00 

2C n = ~~ J s(t)exp( —j(o 0 t)dt 

* — 00 

As a result, we obtain the complex amplitude of an equivalent 
harmonic signal representing the contributions of all the spectral 
components contained within the interval Aco: 

2N 00 

AA Wo = — J s (t) exp (— j(o 0 t) dt = 

* - 00 

Ago “ 

=- J s (0 exp ( —j(o 0 t) df (2.15) 

Here we have defined a new function 


00 

S(co)= j s(t)exp( — jcot)dt (2.16) 

— 00 


which is variously called the amplitude spectral density [20], the 
complex spectral density *, the amplitude spectrum [20], or simply 
the spectrum** of the signal s(t). It is the Fourier transform of the 
signal. 

The physical significance of the spectrum. The result can be best 
interpreted if we change from the angular frequency co to the cyclic 
frequency 

/ = (o/2n 

Then.Eq. (2.15) will take the form 

AA fo = 2S(2nf 0 )Af (2.17) 

It should be interpreted as follows: The spectrum S(2nf 0 ) = S( co 0 ) is 
a scale factor connecting the length of the frequency interval A f and 
the corresponding complex amplitude A Af 0 of the harmonic signal 
at the central frequency f 0 . 

A fact of fundamental importance is that the spectrum is 

* S. Stein and J. Jones. Modern Communication Principles. 

** C. W. Helstrom. Statistical Theory of Signal Detection Oxford: 
Pergamon Press, 1968. A. Peled and B. Liu. Digital Signal Processing. John 
Wiley and Sons, New York, 1976- Translator's note. 
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Fig. 2.5 Vector diagram of a nonperiodic signal (the plot on the right of 
the figure relates the magnitude of the spectral density to frequency) 

a complex function of frequency and, as such, it carries information 
about both the amplitude and the phase of the elementary sine 
waves. On the phasor diagram of a nonperiodic signal (Fig. 2.5), 
the lengths of the elementary phasors are infinitesimal, so instead of 
the broken lines (T is finite) we obtain smooth curves (T tends to 
infinity). If we choose a set of equidistant points 0 < (o 1 < co 2 < ... 
on the’frequency axis, the magnitude of the spectrum, |S(co)|, will 
establish a linear scale along the curves: an increase in the magni¬ 
tude of the spectrum within the specified frequency range will lead 
to an increase in the spacing between the frequency points on the 
phasor diagram as well. 

This diagram has been plotted for some fixed instant of time. 
With time the shape of the curves changes in a very complex 
manner because the angular velocity at which the corresponding 
portions of the curves rotate increases with increasing frequency. 
Actually, however, what is important is not the shape of the curve, 
but the projection of its terminal point on the horizontal axis. 

The inverse Fourier transform. Now we shall solve the inverse 
problem of the spectral theory of signals: We shall recover a signal 
from its spectrum which is deemed to be known. 

Let us assume again that the nonperiodic signal is derived from 
a periodic sequence when its period tends to infinity. Using Eqs. 
(2.13) and (2.14), we may write 

00 1 

s(t)= lim X — SiruoJ exp (jn^t) 

T->con= — oo 7 

The coefficient 1/T is proportional to the difference in frequency 


The signal waveform 
depends on both the 
magnitude and phase 
of the spectrum 
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between adjacent harmonics: 


\/T = tojln = 


—[ft©! — (« — l)©^ 
2n 


for any integer n. Thus, 


m 

The inverse Fourier 
transform 


\ 00 

s(t) = lim — £ S'(nco 1 )exp(/^co 1 0[^co 1 -(n-ljcoj 

T—>oo 2rt n — — co 

Since in the limit of large T the frequency spacing between 
adjacent harmonics decreases without bound, the last sum may be 
replaced with an integral 

1 00 

s(t) = - f S(a>)exp(/cot)dco (2.18) 

-00 

Equation (2.18) is known as the inverse Fourier transform for the 
signal s(t). 

This brings us to a fundamental conclusion: The signal s(t) 
and its spectrum S((£>) are uniquely related by a Fourier transform 
pair: 


00 

S(©) = j s(t)exp(-j<ot)dt 

(2.19) 

1 00 

s(t) = —— j S(co)exp(/a>f)dco 

_ qo 

Solve Problem 3 —-- 

The technique of spectral expansion has substantially enriched 
signal theory. It often happens, for example, that the mathematical 
model of a signal in the form of the function s(t), that is, in the 
time domain, is complicated and not easy to visualize. In contrast, 
the treatment of the same signal in the frequency domain, that is, 
with the aid of the function S (co), proves very simple. What is more 
important, however, is that the spectral representation of signals 
offers a direct approach to the response analysis of a wide class of 
communication circuits and systems. These matters will be taken up 
in detail in Chapters 8 and 9. 

The condition for the existence of the spectrum of a signal. In 

mathematics, it has been explored in detail what properties the 
function s(t) must possess in order that its Fourier transform can 
exist. 

Omitting proof and the rather subtle points that are involved in 
the very concept of the existence of a mathematical entity, we shall 
formulate the final result: For a signal s(t) to have its spectrum 
S(oo), it is essential that the signal should be absolutely integrable, 
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and this means that the integral 


00 

J |s(t)|dt < + oo 

— 00 

should exist. 

The above condition substantially limits the class of eligible 
signals. Thus, we cannot speak, in the classical sense, about the 
spectrum of a harmonic signal, s(t) = Tcos co 0 t, defined along the 
entire infinite time axis. 

Fortunately, present-day mathematics has techniques with which 
the spectra of nonintegrable signals can be evaluated in 
a reasonable way. In this case, however, the spectra will be 
generalized functions, and not the conventional or classical ones. 
The spectral representation of nonintegrable signals will be 
discussed later. 

Now we shall consider several specific examples of how spectra 
are found. 

The spectrum of a rectangular video pulse. Let there be a signal, 
5(0, of amplitude U and duration x p , which is symmetrical about 
the origin of time. On the basis of Eq. (2.16), 

Tp/2 Tp/2 

5 (co )=17 j exp( -j(dt)dt = U j (cos cot — j sin coO dt 

-Tp/2 -Tp/2 


Tp/2 

= 2U j cos cot dt = (21//©) sin (cox p /2) 
0 


The absolute integra- 
bility of a signal 




s 




U 

t 


-Tp/2 0 Tp/2 


Thus, the spectrum of the signal in question is a real function of 
frequency. It is convenient * to introduce a dimensionless variable, 
£ = cot p / 2. Then the result can finally be written as follows: 


S(co)= LTp(sin^) 


( 2 . 20 ) 


It is interesting and important to note that at the zeroth fre¬ 
quency the spectrum is equal to the area of the pulse 

S(0)=Ut p 

A plot of the function in (2.20) is shown in Fig. 2.6. 

The spectrum of an exponential video pulse Consider the signal 
described by the function 

s(t)= U exp (— cut) a ( t ) 

for the positive real value of the parameter a. 

Strictly speaking, such a signal may only arbitrarily be called 
a pulse because of its behaviour at t-> oo. However, the condition 
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between adjacent harmonics: 


l/r = co 1 /27t = — [«©! 


•(«- l)©l] 



for any integer n. Thus, 

1 00 

s(t)= lim —— Yj S{na) 1 )exp(jn(o 1 t)[n(o 1 —(n — \)(£i l ] 

T—>oo 271 n — — oo 


Since in the limit of large T the frequency spacing between 
adjacent harmonics decreases without bound, the last sum may be 
replaced with an integral 


The inverse Fourier 
transform 


1 00 

s(t) = —— f S(co)exp(/cot)dc 0 (2.18) 

2n -00 

Equation (2.18) is known as the inverse Fourier transform for the 
signal s(t). 

This brings us to a fundamental conclusion: The signal s(t) 
and its spectrum S(o) are uniquely related by a Fourier transform 
pair: 


oo 

S( co)= J s(£)exp( — jcot)dt 

(2.19) 

1 00 

s (t) = —— f S (co) exp(yco£) dco 

2lZ -OO 

Solve Problem 3 - 

The technique of spectral expansion has substantially enriched 
signal theory. It often happens, for example, that the mathematical 
model of a signal in the form of the function s(t\ that is, in the 
time domain, is complicated and not easy to visualize. In contrast, 
the treatment of the same signal in the frequency domain, that is, 
with the aid of the function S (co), proves very simple. What is more 
important, however, is that the spectral representation of signals 
offers a direct approach to the response analysis of a wide class of 
communication circuits and systems. These matters will be taken up 
in detail in Chapters 8 and 9. 

The condition for the existence of the spectrum of a signal. In 

mathematics, it has been explored in detail what properties the 
function s(t) must possess in order that its Fourier transform can 
exist. 

Omitting proof and the rather subtle points that are involved in 
the very concept of the existence of a mathematical entity, we shall 
formulate the final result: For a signal s(t) to have its spectrum 
•S(co), it is essential that the signal should be absolutely integrable, 
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and this means that the integral 


J \s(t)\dt < + oo 

— 00 

should exist. 

The above condition substantially limits the class of eligible 
signals. Thus, we cannot speak, in the classical sense, about the 
spectrum of a harmonic signal, s(t) = A cos co 0 £, defined along the 
entire infinite time axis. 

Fortunately, present-day mathematics has techniques with which 
the spectra of nonintegrable signals can be evaluated in 
a reasonable way. In this case, however, the spectra will be 
generalized functions, and not the conventional or classical ones. 
The spectral representation of nonintegrable signals will be 
discussed later. 

Now we shall consider several specific examples of how spectra 
are found. 

The spectrum of a rectangular video pulse. Let there be a signal, 
s(t), of amplitude U and duration t p , which is symmetrical about 
the origin of time. On the basis of Eq. (2.16), 

tp/2 tp/2 

S (co) = U j exp (- jcot) d t=U j (cos co t —j sin cot) d£ 

-ip/2 “Xp/2 


Xp/2 

= 2U J cosco£d£ = (2I//co)sin(coT p /2) 
0 


■ 

The absolute integra- 
bility of a signal 



Thus, the spectrum of the signal in question is a real function of 
frequency. It is convenient*to introduce a dimensionless variable, 
^ = cox p /2. Then the result can finally be written as follows: 


S(co)= U t p (sin £/£) 


( 2 . 20 ) 


It is interesting and important to note that at the zeroth fre¬ 
quency the spectrum is equal to the area of the pulse 

S (0) = Uxp 

A plot of the function in (2.20) is shown in Fig. 2.6. 

The spectrum of an exponential video pulse Consider the signal 
described by the function 

s (t) = U exp (— at) a ( t ) 

for the positive real value of the parameter a. 

Strictly speaking, such a signal may only arbitrarily be called 
a pulse because of its behaviour at £->oo. However, the condition 
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r 



Fig. 2.6 Plot of the relative spectrum of a rectangular video pulse as 
a function of the parameter \ — coTp/2 


A 

Solve Problems 5 
and 6 


a >0 assures a sufficiently rapid (exponential) decrease of the 
instantaneous values of the signal with increasing time. In 
communication engineering, the practical duration of such pulses is 
taken to be that over which the signal decreases to one-tenth of its 
original level: 

exp( — ai p ) = 0.1 

Hence, 

ip = 2.3026/a 

The spectrum of an exponential video pulse is given by 

00 

S (co) = U j exp [ - (a + 7 ‘co) t ] d t 
0 

= [ - U/(cl + y'co)] exp [- (a + ;co) {]%<§ 

= U/(a+jco) (2.21) 


The spectrum of an exponential waveform differs from that of 
a rectangular pulse in two fundamental aspects: 

1. In accordance with Eq. (2.21), the spectrum S(co) does not go 
to zero at any finite value of frequency. 

2. The spectrum of an exponential pulse is a complex-valued 
function 

S(co)= | SMI exp [j \|/(©)] 

with modulus | S(oo) | = IZ/j/a 2 + co 2 , and argument \|/(co) = 
= — arc tan (co/a). 

The respective plots appear in Figs. 2.7 and 2.8. 

The spectrum of a Gaussian video pulse. This type of signal is 
described by a function of the form 

s(t) = U ex p(— fit 2 ) 
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Fig. 2.7 The magnitude of the 
spectrum of an exponential 
pulse 



u>/a 


Fig. 2.8 The argument of 
the spectrum of an 
exponential pulse 


This mathematical model is often used in cases where the pulse 
has a high degree of “smoothness”. The effective duration of 
a Gaussian pulse is taken to be that over which the signal decreases 
to one-tenth of its maximum level. Referring to the plot, it can be 
seen that the duration x p must satisfy the relation 

exp[-P(x P /2) 2 ] = 0.1 


On re-arranging, we get 

Tp = 2^/ — In 0.1/l/p = 3.035/l/p (2.22) 

To determine the spectrum, we need to evaluate the integral 

00 

S(a»)=t/ J exp(-pt 2 )exp(- 7 'cot)dt (2.23) 

< — 00 

Now the integrand should be re-arranged in such a way that we 
may use the tabulated integral 

j exp( — x 2 )dx = |/tc 

— 00 

For this purpose, from the exponent in (2.23) we isolate the 
complete square: 


fit 2 + jodt = fit 2 + jcot - oo 2 /4|3 + co 2 /4(3 
= (]/|3 1 + jco/2 j/p ) 2 + co 2 /4p 



Therefore, 

00 

S (co) = U exp ( - co 2 /4P) j exp 

— 00 

Let us introduce a new variable 


]/fit-\- 


2J/P 


d t 


^ = Fpt+;co/21/P 

such that 

dt = d^/j/p 


























56 


Part One. Signals 


As a result, the sought spectrum takes the form 
U exp (— oo 2 /4P) 


S(CO): 


V* 


J exp(-a^ 


Hence, finally, 

S (a>) = U 1/^/p exp (- co 2 /4p) 


(2.24) 


To sum up, the spectrum of a Gaussian pulse is real and is 
described likewise by a Gaussian function of frequency. 

The spectrum of the delta function. Let the signal s (t) be a short 
pulse concentrated at point t = 0 and having an area A. The 
mathematical model of this pulse is 


s(t) = A5(t) 

To find the spectrum of this signal, we need to evaluate the 
integral 

00 

S(co) = ,4 j exp(— jot)5(t)dt 


In Chapter 1 we have learned about the filtering properties of the 
delta function. This integral is equal to the value of the classical 
function at the point where the generalized function is concentrated. 
Therefore, 


S (co) = A = const 


(2.25) 


This behaviour of the 
delta function spect¬ 
rum is due to the ini¬ 
tial idealization 


|S|max 


0.11S | n 


l" — 


u up 


$ 

Bandwidth 


Thus, the 5-impulse has a flat spectrum at all frequencies. It is 
interesting to interpret the result on a phasor diagram (see Fig. 2.5). 
Just as the impulse occurs (£ = 0), all elementary harmonic 
components which differ in frequency combine coherently, because 
in accord with Eq. (2.25) the spectrum is real. As the frequency is 
increased, their amplitudes do not decrease (compare with the 
previous examples). In consequence, the signal has an infinitely 
large magnitude at t = 0. At all other times the phasor sum of the 
components is zero. 

Relation between the duration and bandwidth of a pulse. From 
an analysis of the special cases examined so far, an important 
conclusion may be drawn: ,4s the duration of a pulse decreases , its 
bandwidth broadens. 

Here and elsewhere, the bandwidth refers to the frequency 
interval within which the modulus of the spectrum is not smaller 
than some specified level. For example, it may range between |S| m ax 
and 0.1 l^lmax- 

Consider a rectangular video pulse and assume that the upper 
frequency limit is the frequency at which the first zero occurs in the 
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spectrum. This frequency can readily be found from the condition 

©up ^p/2 = ft 

or 

/up T p = 1 

In the case of an exponential video pulse, we arbitrarily assume 
that at the upper frequency limit the modulus of the spectrum 
reduces to one-tenth of its maximum value. Hence, it follows (see 
Eq. (2.20) and further) that 

1 / V 1 +((Oup/a ) 2 = 0.1 

or 

©up = 1/99 a 
and 

/up = ©up/2tt = 1.584a 

Since the effective duration of an exponential pulse is 
ip = 2.303/a 
the product 
/up T p = 3.647 

Finally, the spectrum of the 5-impulse which has an infinitesimal 
duration extends along the frequency axis without bound. 

To sum up, the product of the bandwidth by pulse duration is 
a constant number which depends solely on the pulse form and has, 
as a rule, a value of the order of unity: 

/upTp =0(1) 

The above relation is of primary importance for communication 
engineering. It sets the requirement for the bandwidth of 
a particular circuit or device when the signal duration is specified in 
advance. For example, as the pulse duration is reduced, the 
bandwidth of the amplifier that is to handle the signal must be 
increased in proportion. By the same token, short noise pulses 
which possess a broad bandwidth may impair the quality of 
reception over a significant frequency band. 


2.3 Basic Properties of the Fourier Transform 

In the preceding section we have learned how the Fourier 
transformation is applied and have found the spectra of simple, but 
frequently occurring pulse signals. Now we shall consider the 
properties of the Fourier transform. 


A 

Solve Problem 4 


♦ 

It is said that the 
bandwidth and dura¬ 
tion of a pulse are 
connected by the “un¬ 
certainty relation” 
(The term has been 
borrowed from quan¬ 
tum mechanics.) 
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Linearity of the Fourier transform. Given a set of signals s x ( t ), 
s 2 (t), ..., we can define the Fourier transform of their weighted sum 
by the formula 


£ nsi (t) «-► y riS i (to) (2.26) 


Here r* are arbitrary numerical coefficients. The validity of Eq. 
(2.26) can be proved by directly substituting the sums of signals in 
the Fourier transform (2.16). 

Properties of the real and imaginary parts of the spectrum. Let 
s(t) be a signal which takes on real values. In the general case, it 
has a complex spectrum 

00 00 

S(co) = J s(t)cos(otdt— j J s(t)sin(£>tdt = A(o))— jB(a)) 

— 00 — 00 

On substituting the above expression in the Fourier inversion 
formula, Eq. (2.18), we get 

1 00 

s ( t ) = —— J [A (co) — jB (co)] (cos co t + j sin cot) dco 
2tc 


The integral of an odd 
function between sym¬ 
metric limits is always 
equal to zero 


This will occur only if the following condition is satisfied: The real 
part A((o) of the spectrum of the signal is an even function of fre¬ 
quency and the imaginary part B( coj is an odd function of frequency : 

A(g>) = A(-(b)B((q) = — J5( — co) (2.27) 

The spectrum of a time-shifted signal. Suppose that for a signal 
s(t) we know that 

s(t)<-+S( co) 

Consider a similar signal, but occurring t 0 seconds later. Taking the 
point t 0 as the new origin of time, we can designate the translated 
signal as s(t — t 0 ). Let us show that 


For the signal subjected to a direct and an inverse Fourier 
transformation to remain real, we must require that 

00 

j ^4(co)sin cot dco = 0 

— 00 

and 

00 

j B (co) cos cot dco = 0 

— 00 


S (t - to) s (®) ex P ( - Mo) 


(2.28) 
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This is so because 

CO 

s(t-t 0 )~ J s(t-t 0 )exp(-M)dt 

— 00 
00 

= I s(x) exp ( —Mo) exp ( -jm) dx 

— 00 

= S(co) exp (— 7 'cot 0 ) 

At any value of t Q the complex number exp( -j(ot 0 ) has a modu¬ 
lus of unity. Therefore, the amplitudes of the elementary harmonics 
that constitute the signal are independent of its position on the time 
axis. Information about the signal is embedded in the phase angle 
of its spectrum. 

The dependence of the spectrum on the time scale adopted. 
Suppose that the original signal s{t) is subjected to 
a transformation involving a change in the time scale. This implies 
that the role of time t is now played by the new independent 
variable kt (here k is some real number). If /c > 1, the original signal 
is compressed in time. If 0</c<l, the signal is expanded. 
It has been found that if s(f)<->S(co), then 


s{kt)<r+ — S(co/k) (2.29) 

k 


To demonstrate, 

oo 1 00 

s(kt)*-> j s(kt) exp ( —jot) dt = — J s(x)exp(-j(ox/k)dx 

from which Eq. (2.29) follows directly. 

Thus, if we wish to compress a signal in time while retaining its 
form, we should distribute the same spectral components over 
a broader frequency interval and reduce their amplitudes in 
proportion. 

An interesting special case of time scale transformation is the 
reversal in time, k= - 1. Using Eq. (2.29), we find the spectrum of 
the time-inverted signal: 


s (hnv) «-> - S (- co) (2.30) 


In the case of time reversal, the modulus of the spectrum remains 
unchanged, but the positive and negative frequency regions of the 
spectrum are interchanged, and the initial phases of all harmonics 
are shifted through 180°. 


A change of variable 

t — to = x 


The original signal 



The compressed signal 
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m 

Convolution 


▲ 

Work Problems 7 and 
8 


The integral on the right-hand side of Eq. (2.35) is called the 
convolution of the functions V and U. Symbolically, it will be de¬ 
signated as 

J P(£)t/(a>-S)d£= F(co)*U(co) 

— 00 

Thus the spectrum of the product of two signals is equal, to 
within a constant, to the convolution of the spectra of the 
cofactors: 


u(t)v(t)~^fv(a)*U(a) ( * 1 2 - 36 ) 

2n 


The reader can readily prove that the operation of convolution is 
commutative. This means that the order of the functions involved 
may be reversed: 

V(a)*U (to) = U(a)* V (co) 

The convolution theorem we have just proved may be reversed. If 
the spectrum of a signal can be represented as the product 

S (co) = Si (co) S 2 (co) 

such that S 1 (<o)++s 1 (t) and S 2 (co)«-*s 2 (t), then the signal s(t)+*S( o) 
is the convolution of the signals Sj(t) and s 2 (t), but in the time 
rather than in the frequency domain: 

Si (<o)S 2 (©)«-♦ | s 1 (t-^)s 2 ©d^ (2-37) 

— 00 

We leave it for the reader to prove this formula. 

2.4 Spectra of Nonintegrable Signals 

Many of the mathematical models widely used in communication 
theory do not satisfy the requirement of absolute integrability. This 
implies that the Fourier transformation in its usual form is not 
applicable. Yet, as already noted, we may speak of the spectra of 
such signals, if we assume that these spectra may be described by 
generalized functions. 

The spectrum of a time-invariant signal. The simplest 
nonintegrable signal is a constant quantity, U 0 = const. Suppose 
that this signal can be represented by an inverse Fourier transform 

1 00 

U 0 = — f S(co)exp(/cot)dco 
2tc 
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in which the spectrum S(co) is yet unknown. If we recall the filtering 
properties of the delta function, it is an easy matter to conclude 
that for this equality to be satisfied identically, we must set 

5(co) = 2tcL/ 0 5(co) 

Then, 


U o 2 tc U 0 8 (co) (2.38) 


The physical meaning of the above result is easy to grasp: 
A time-invariant signal has a spectral component solely at the 
zeroth frequency. 

The spectrum of a complex exponential signal Let 
s(t) = exp (j(o 0 t) 

be a complex exponential signal of a known frequency co 0 . It is easy 
to see that this signal does not possess the property of absolute 
integrability, because the function s(t) does not tend to any limit as 
t goes to ± oo. 

Let us take the Fourier transform of the signal: 

1 00 

exp(/co 0 t) =- f S(<»)exp(/<»t)d<D 

2n -4 

and match the spectrum so that the equality turns to an identity. 
Using the filtering properties of the delta function, we immediately 
obtain 'an important result: 


exp ( jco 0 t ) «-► 2nd (co — oo 0 ) ^ (2.39) 


The following points deserve to be noted. 

(1) The spectrum of a complex exponential signal is zero 
everywhere except the point co = co 0 , where it has 
a delta-singularity. 

(2) The spectrum of a given signal is not symmetrical about the 
point co = 0, but is concentrated in the region of either positive or 
negative frequencies. 

The spectrum of harmonic oscillations. Let 
s(t) = cos co 0 t 
By Euler’s formula, 

s(r) = [exp (/©of) + exp( -;co o 0]/2 

From the spectrum of the complex exponential signal derived 
earlier and from the linearity of the Fourier transform, we may 
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immediately write the spectrum of a cosine signal as 


cos ov it [5 (co - <d 0 ) + 5 (co + co 0 )] (240) 


The reader himself can readily prove that for a sine signal the 
following relation is valid 


sin co 0 t~ - ®o) - 8(© + ®o)l (2M) 


The two signals are real functions of time, therefore their spectra 

are even or odd functions of frequency. , 

The spectrum of an arbitrary periodic signal Earlier, we analysed 
periodic signals with the aid of Fourier series. Now we can expand 
our idea about their spectral properties and describe periodic 
signals by use of Fourier transforms. 

Let 

00 

s(t)= £ C„exp(/H<V) 

n= -oo 

be a periodic signal defined by a complex Fourier series of its own. 
On the basis of Eq. (2.39) and recalling the linearity of Fourier 
transformation, we can immediately write the spectrum 
signal as 


S(co) = 2it X C^co-ncOi) (2 ' 42) 

n= - oo 



In configuration, the corresponding plot of the spectrum js identical 
to the usual spectral diagram of a periodic signal. T p 
med by 5-impulses in the frequency interval ±m»i. 

The spectrum of the switching function. As the last example of 
how to calculate the spectrum of a nonintegrable signal, wesha 
consider the spectrum of the switching function a(t ) which or 
simplicity, we shall define at all points except the point t- 0 (cl. 
(1.2)): 


a(t) = 


1, t>0 
0, t<0 


To begin with, it should be noted that the switching function can 
be derived from an exponential video pulse by passing to the lirni . 


lim exp( 
oc->o 


at), t > 0 


a(t) = 


t < 0 
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Therefore, in order to find the spectrum of the switching function, The expression for the 
we should pass to the limit as a-»0. spectrum of an expo- 

1 nential pulse is used 

a(t)<-» lim- 

a _ 0 a+7CD 


The direct passage to the limit, under which 
o(f)<-» l//co 

holds at all frequencies except at co = 0. This case must be examined 
separately. 

To begin with, we split the spectrum of an exponential signal into 
its real and imaginary parts: 

1 a yco 

(a + /co) cl 2 + co 2 a 2 + co 2 

The limiting value of the first term vanishes for any co ^ 0. On 
the other hand, 

adco ® d(co/a) 

-oo a 2 + co 2 -oo 1 + (®/a) 2 % 


irrespective of the magnitude of a. Hence 

lim —zr = 7t5(co) 

a-»o a 2 + CO 2 

To sum up, the switching function and its spectrum are 
connected by a relation of the form 


a (t) <-+ 7i5 (co) + 1 //co (2.43) 


The presence of a delta-singularity in this spectrum at co = 0 is an 
indication that this signal contains a constant term equal to 1/2. 

The spectrum of radio pulses. As will be recalled, a radio pulse 
u r (t) can be defined as the product of a video pulse u w (t), which acts 
as the envelope, and a nonin tegrable harmonic oscillation: 

u r (0 = u v ( t ) cos (oo 0 t + cp 0 ) (2.44) 

In finding the spectrum of a radio pulse, we assume to know the 
function S v (co), which is the spectrum of its envelope. The spectrum 
of a cosine signal with an arbitrary initial phase is obtained by 
generalizing Eq. (2.40): 

cos (co 0 t + cp 0 ) n [5(co - co 0 ) exp (/cp 0 ) 

+ 5(co + co 0 )exp( —7‘cpo)] (2.45) 


Inaccurately, Eq. 
(2.43) is sometimes 
written with only the 
second term 


Solve Problem 16 


3-728 
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The spectrum of a radio pulse is the convolution of the spectra of 
two signals, u w (t) and cos(co 0 t + cp 0 ): 

1 00 

Sr(®) = — J Sv(<o-^)[5(£-cOo)exp0'cp o ) 

2 — OO 

+ 5(£ + a>o)exp(-ycp 0 )]d£ 

Recalling the filtering properties of the delta function, we obtain 


▲ 

Solve Problem 10 


S r (o>) = y expO’<Po)Sv(co - co 0 ) + y exp (-7cp 0 )Sv(co + C 0 0 ) (2.46) 


The manner in which the spectrum of a video pulse is transfor¬ 
med when it is multiplied by an r. f. harmonic oscillation is illustrat¬ 
ed in Fig. 2.9. 

Thus, in spectral terms the change-over from a video pulse to 
a radio pulse implies the translation of the spectrum of the video 
pulse into the r.f range. Instead of one maximum at a> = 0, the 
spectrum displays two maxima at oo= ±co 0 which are halved in 
absolute value. 



Fig. 2.9 Frequency dependence of the magnitude of the spectrum: (a) for 
a video pulse; ( b ) for a radio pulse 


It is to be noted that the plots in Fig. 2.9 apply to the case where 
the frequency (o 0 is substantially higher than the effective bandwidth 
of the video pulse. (Precisely this case is usually realized in 
practice.) As is seen, there is no noticeable overlap between the 
spectra for positive and negative frequencies. However, it may so 
happen that the bandwidth of the video pulse is so broad (in the 
case of a short pulse) that the selected value of frequency co 0 is not 
sufficient to avoid overlapping. In consequence, the spectra of the 
video pulse and of the radio pulse cease to be similar in shape. 


Example 2.3. Find the spectrum of a rectangular radio pulse. 
For simplicity, we set the initial phase in (2.44) equal to zero. 
Then the mathematical model of the radio pulse takes the form 

Mr (t) = U [a (£) - a (t - ip)] cos c o 0 t 
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Knowing the spectrum of the corresponding video pulse, Eq. 
(2.20), and using Eq. (2.46), we find the sought spectrum 


SrH = 


U x D 


sm 


(CD-COobp 


sm 


(CD + 00 o ) Tp 


(co-co 0 )Tp 


- + - 


(co + co 0 )ip 


(2.47) 


The results found by Eq. (2.47) for two typical cases are shown in 
Fig. 2.10. In the first case, the envelope encompasses 10 cycles of 
the r. f. carrier (co 0 x p = 20rc), and the frequency co 0 is sufficiently high 
to avoid any overlap. In the second case, there is only one cycle of 
the r. f. carrier (co 0 x p = 27u). Due to the superposition of the positive 
and negative frequency components, the spectrum of the radio pulse 
has the characteristic asymmetrical lobed structure. 




Sr 



■Wh 

P’W 



-u>0 u> 0 

C a) 



Fig. 2.10 Spectra of a radio pulse with a rectangular envelope: (a) for 
oo 0 Tp= 207t; ( b ) for co 0 T p = 27r 


2.5 The Laplace Transform 

In addition to Fourier transforms, communication theory widely 
uses another class of integral transforms to tackle a large variety of 
problems arising in the study of signals. They are Laplace 
transforms. 

The concept of complex frequency. As we have seen, signal 
analysis by spectral methods is based on the fact that the signal of 
interest is represented as a sum of an infinitely large number of 
elementary components each of which varies in time as exp (/cot). 

A natural generalization of the principle consists in that complex 
exponential signals with imaginary exponents are replaced with 
exponential signals of the form exp (pt\ where p is a complex 
number such that 

p = a+ycQ # 

known as the complex frequency. The complex frequen- 

Any two of such complex signals can always be combined to cy 


3 * 
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produce a real signal by, say, the following rule: 

s(t) = y [exp(pt) + exp(p*t)] (2.48) 

where 
p* = ct - jco 

is the complex conjugate of p. To demonstrate, 

,, , ^ exp (/cot) + exp ( —j(ot) 

s(t) = exp (at)- - - 

= exp (at) cos cot (2.49) 

A large variety of real signals can be derived, depending on the 
choice of the real and imaginary parts of the complex frequency. 
For example, if a = 0, but co #= 0, we obtain the usual harmonic 
oscillations of the form cos cot. If, on the other hand, co = 0, we will 
obtain exponential oscillations either building up or decaying with 
time, depending on the sign of a. More complex signal waveforms 
arise when co # 0. Now, the factor exp (at) plays the part of the 




Fig. 2.11 Real signals corresponding to various values of the complex 
frequency 

envelope exponentially varying with time. Some of the most typical 
signals are shown in Fig. 2.11. 

The introduction of complex frequency is very fruitful above all 
because we can, without resorting to generalized functions, obtain 
the spectral representations of signals whose mathematical models 
are nonintegrable. More importantly, exponential signals of the 
form defined in Eq. (2.49) provide a “natural” means for studying 
signals in various linear systems. This matter will be taken up in 
detail in Chap. 8. 

It is to be noted that the true physical frequency acts as the 
imaginary part of the complex frequency. 
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Basic relations. Let / (t) be a signal, real or complex, defined at 
t > 0 and identically equal to zero at negative values of time. The 
Laplace transform, F (p), of this signal is defined by the integral 


00 

F(p)=S f(t) exp (-pt)dt (2.50) 

0 


The signal f(t) is the original time function, and the function F(p) 
is its Laplace transform. 

The condition for the integral in (2.50) to exist consists in the 
following: The signal f(t) may not grow faster than exponentially at 
t> 0, that is, it must satisfy the inequality 

|/(0 |</c exp (at) (2.51) 

where k and a are positive numbers. 

When the above inequality is satisfied, the function F (p) exists in 
the sense that the integral in (2.50) absolutely converges for all 
complex numbers p for which Re (p) > a. The number a is called the 
abscissa of absolute convergence. 

The variable p in the basic formula (2.50) may be identified with 
the complex frequency p = a + ;co. Indeed, in the case of a purely 
imaginary complex frequency when a = 0, Eq. (2.50) goes into Eq. 
(2.16) defining the Fourier transform of a signal which vanishes at 
t < 0. Thus, the Laplace transformation should be looked upon as 
a generalization of the Fourier transformation to complex fre¬ 
quencies. 

As with Fourier transforms, if we know a Laplace transform, we 
can recover the corresponding original time function. For this 
purpose, in the Fourier inversion formula 

1 00 

f(t) = — J F(co)exp(/cof)dco 
2rc -co 

we should perform an analytic continuation by changing from the 
imaginary variable jco to the complex argument (a + jco). On the 
complex-frequency plane, it is usual to carry out integration along 
an infinitely extended vertical axis located to the right of the 
abscissa of absolute convergence. Since at a = const the differential 
dco = (1 /j)dp, the inverse Laplace transform takes the form 


I C+j 00 

M = ~ j F(p) exp (pt)dp 

c—j oo 


(2.52) 


• 

The condition for the 
existence of the Lapla¬ 
ce transform 


Relation between the 
Laplace and Fourier 
transforms 



























70 


Part One. Signals 


In the theory of functions of a complex variable it is shown that 
Laplace transforms are well-behaved in terms of smoothness; they 
are analytic at all points on the complex p- plane, except the 
countable set of so-called singular points. The singular points are, 
as a rule, poles, single or repeated. Integrals of the form (2.52) can 
be evaluated by the techniques used in the theory of residues [11]. 

The Laplace transform and the inverse Laplace transform are 
referred to as a Laplace transform pair. In practice it is often 
convenient to look up each if the other is known in a set of tables. 
One such table is given in Appendix 4. It permits handling 
a sufficiently wide range of problems. 

Examples of finding Laplace transforms. The calculation of 
Laplace transforms has much in common with finding Fourier 
transforms examined previously. Therefore, we shall limit ourselves 
to the most typical cases. 

Example 2.4. The Laplace transform of a generalized exponential 
pulse. 

Let 

/(t) = exp(p 0 t)CT(t) 
where 

Po = CT o +> o 

is a fixed complex number. Owing to the presence of the a- 
function,/(f) = 0 at t<0. Using Eq. (2.50), we get 

® r , , ,, exp[-(p-p 0 )t] 

F(p) = J exp[ - (p- p 0 )t]dt =-—- 

o P p o 

If Re p > ct 0 , then, on substituting the upper limit, the numerator 
vanishes, and we get the following correspondence 


00 

0 


exp (p 0 t)o(t) =l/(p- Po) 


(2.53) 


As a special case of Eq. (2.53), we can obtain the Laplace 
transform of a real exponential video pulse: 


exp (— at) a(t) = l/(p + a) (2.54) 

and of a complex exponential signal: 


exp (/co 0 t) o (f) =l/(p — j(o 0 ) 


(2.55) 


Finally, on setting a = 0 in Eq. (2.54), we obtain the Laplace 
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transform of the Heaviside function: 


cr(t) = i ip 


(2.56) 


Example 2.5. The Laplace transform of the delta function. 
If the 5-impulse occurs at time t 0 > 0, we need to evaluate the 
integral 

00 

J 8(t-t 0 )exp(-pt)dt = exp(-pt 0 ) 

0 

Then the Laplace transform of the delta function takes the form 


5(t-t 0 ) =exp(-pt 0 ) (2.57) 


The Laplace transform in (2.57) is defined at all points on the 
complex p-plane. It has singularities nowhere except at infinity. 

A certain difficulty may arise in taking the Laplace transform of 
the 5-impulse concentrated at t = 0, because it is not clear how we 
should treat the contribution from the generalized function 
concentrated at one of the ends of the range of integration. The 
point is that the delta function (see Ch. 1) is defined as the limit of 
a sequence of pulses, symmetrical about t = 0. If we proceed from 
formal considerations, then only a half of the pulse will fall within 
the range of integration, and this will result in halving the magni¬ 
tude of the integral. To avoid this, the Laplace transform of 5 (t) is 
defined as the limit 
• 00 

lim J 5 (t) exp (- pt) dt = 1 

e->o o-£ 

independent of the parameter 8. With this approach, the delta 
t function always belongs to the region of integration and has 
0 a Laplace transform of unit: 


The 5-impulse belongs 
to the region />0 


5(0=1. 


(2.58) 


2.6 Basic Properties of the Laplace Transform 

Most properties of the Laplace transform are the same as the 
analogous properties of the Fourier transform. Therefore, in the 
subsequent discussion we will supply a proof only where the need 
to do so arises. 

Linearity. The Laplace transformation is a linear integral 
transformation. Therefore, the weighted sum of signals is transform- 




































72 


Part One. Signals 



ed as follows: 


Zn/iW =1 nFAp) 


(2.59) 


On the strength of this property, it is an easy matter to take the 
Laplace transforms of signals which may be represented as sums ot 
relatively simple components for which the Laplace transforms are 
already known. For example, using Euler’s formula and considering 
the Laplace transform pair in (2.55), we find that 


cos a> 0 ta(t) = p/{p 2 + (Bo) 


(2.60) 


sin co 0 tcr(t) = <b 0 /(p 2 + a>o) 


(2.61) 


The Laplace transform of a signal translated in time. If 

fit) =F(p) 
we may write 

f(t- t 0 ) = exp (- pt 0 ) F (p) (162) 

As an example, let us take the Laplace transform of a rectangular 
video pulse of unit amplitude and of duration x P , which occurs at 
t = 0. It will suffice to note that this pulse is the difference of two 
switching functions translated in time by x p . Using Eq. (2.56), we 
obtain 

(2.63) 


f(t) =(1 /p)D -exp(-px p )] 

The shifting theorem. Basically, it runs as follows: If/(t) =F(p), 
the Laplace "transform of a signal multiplied by an exponential 
function of time is obtained by shifting the argument of the Laplace 
transform: 

/ (t) exp ( — at) =F(p + a) (2.64) 

The theorem is proved by the direct substitution of the function 

/(t) exp ( — at) in (2.50). , 

By virtue of this property, we can, for example, take the Laplace 
transforms of exponential signals with a harmonic carrier. Thus, on 
the basis of (2.60) and (2.61), we get 


exp( — at) cosco 0 t = 


p + a 


(P + a) 


2 + ®o 


(2.65) 
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exp ( — at) sin co 0 t = 


co n 


(p + a) 2 + C0q 


( 2 . 66 ) 


The Laplace transform of the derivatives of a signal. The Laplace 
transform of the first derivative of a signal is taken by integration 
by parts 

= ] (d//dt)exp( - pt)dt 

(dt 0 

oo oo 

=/(t)exp(-pt) | +p|/(t)exp(-pt)dt 
0 0 

It is easy to see that the Laplace transform of the derivative 
contains the value of the signal at the initial point: 


df/dt =pF(p)-f(0) (2-67) 

The Laplace transform of the nth derivative is found by induction 
d"//dt" = p"F (p) - p n ~ l f(0) -f~ 2 f (0) - • • • 

- pf ( n - 2 ) {0) _f(n-l) {0) (2.68) 

Since Laplace transforms contain the initial state of the signal at 
t = 0, we may use the Laplace transformation to solve linear 
differential equations with known initial conditions [11]. 

The Laplace transform of an integral. If the signal is zero at 
t = 0, then 

J/fc)d5 =F(p)/p ' (2-69) 


As an example of the above rule, let us take the Laplace 
transform of a ramp function: 

fit) =tcy(t) 

To begin with, it is to be noted that f(t) is the integral of the 
switching function 

t<j(0 = f a(^)d^ 

0 

Since 
a(r) =1 Ip 
it follows then that 

MO =1 !v 2 


(2.70) 
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A 

Solve Problem 11 

where 

0 

The above relation provides a convenient means for taking the 
Laplace transform of a signal which may be factored , that is, 
represented by the product of two signals with known Laplace 
transforms. 

Relationship between the limiting values of Laplace transforms 
and the original time functions. Let F(p) be the Laplace transform 
of the time function/(t). Then the following statement is valid: The 
behaviour of the Laplace transform near the origin of the 
coordinate system of the complex p-plane determines the nature of 
the original time function in the limit t -> oo: 
lim pF(p)= lim f(t ) (2.72) 

0 t-*oo 

If the signal f(t) does not contain delta singularities at zero, the 
formula 

lim pF {p) =/(0) (2.73) 

p~> 00 

also holds. 


The Laplace transform of the convolution of two signals. 
Similarly to the Fourier transform, the Laplace transform has the 
following property: There is a one-to-one correspondence between 
the convolution of two signals and the product of their Laplace 
transforms: 

=F 1 (p)F 2 (p) (2-71) 


Summary 

00 The spectral representation of a signal is its decomposition into a sum (which may be 
finite or infinite) of elementary harmonic signals differing in frequency. 

00 A periodic signal can be represented by a Fourier series which is formed, generally 
speaking, by adding together an infinite number of harmonics at frequencies which are 
multiples of the fundamental repetition frequency of the signal sequence. 

00 The spectral representation of a nonperiodic (notably, pulse) signal is accomplished 
by expanding it into a Fourier integral. 

00 In the frequency domain, a signal is characterized by its spectrum. 

A signal and its spectrum are uniquely related by a Fourier transform pair. 

<X> For the spectrum to exist in the classical sense, it is essential that the corresponding 
signal be absolutely integrable. 

00 The spectrum of a nonintegrable signal contains a singularity of the delta-function 
type. 

00 Exponential variations in the amplitude of oscillations with time are described in 
terms of complex frequency. 
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00 The introduction of complex frequency in the Fourier transform results in a new type 
of integral transformation called the Laplace transform. 

00 Signals to which the Laplace transformation is applicable must be zero at t< 0. 

Review Questions 

1. Why does the simple harmonic oscillation cos (co 0 t + cp 0 ) play an especially important 
role in communication engineering? 

2. State the exact definition of a periodic signal. Name several physical processes for 
which the periodic signal model offers a sufficiently accurate representation. 

3. Define the cut-off angle of a harmonic oscillation. 

4. Define the concept of negative frequency. Explain its meaning. 

5. What is the effect of coherent addition in the case of harmonic oscillations. 

6. What properties should the spectrum of a real signal possess? 

7. What is the practical limit for the duration of pulse signals? 

8. What is a distinction of the spectrum of the 8-impulse? 

9. How are the duration of a pulse and its bandwidth related? 

I o' How are the differentiation and integration of a signal represented in the frequency 
domain? 

11. How are the spectra of a video pulse and of a radio pulse related? 

12. What is the object of introducing the concept of complex frequency? 

13. Describe the effect produced by the overlap of the frequency intervals in the spectrum of 
a radio pulse. 

14. State the conditions that a signal should satisfy in order that its Laplace translorm can 

be taken. . 

15. How is the Laplace transform of the product of two signals taken ? 

16. If we know the Laplace transform of a signal, how can we predict the asymptotic 
behaviour of the signal in the limit t-* col 


Problems 

1. Show that the Fourier series of the 
sawtooth waveform shown in the figure 



s (f) = (A/2) - (A/n) [sin coj t 

+ (sin2co 1 t)/2 

+ (sin 3 (0^)13 + ...] 


2. Find the amplitude coefficient of the 
25th harmonic of a sawtooth signal, if A = 
= 30 V. 

3. Show that if a periodic sequence is 
formed by the repetition of a pulse s 0 (t) of 
known spectrum S 0 (oi). the complex 
amplitude of the nth member of the Fourier 
series is 

C n = (2/T)S 0 (m^) 

where T is the period of the sequence. 

4. Given: a two-sided exponential video 
pulse 

s(t) = [/ 0 exp(-a|r|) 
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To find: An expression for its spectrum. 
Determine the duration and bandwidth of 
the signal. 

5. Calculate the spectrum of the 
exponential video pulse defined in Eq. (2.21) 
with an amplitude of 20 Y and a parameter 
oc = 10 6 s ~ 1 at a frequency 

co 0 = 2 x 10 5 s “ 1 * 

6. At what frequency will the spectrum of 
the pulse in Problem 5 have a phase angle 
of — 45° ? 

7. Verify that the spectrum of the single 
cosine pulse shown in the accompanying 
figure 



and defined as 

0, t<t 1 

Acosco 0 t, t 1 <t<t 2 
S W=) 0 ,t>t 2 


can be found by the formula 
7l(C0 0 + CD) 


sm - 


S(co) = A 


2cd 0 


C0 o + CD 


K (C0 0 — CO) 



C0 0 — CD 


8. Find the spectrum of a train of 
n identical video pulses, as shown in the 
accompanying figure: 


* In this text the unit of angular frequency is 
taken to be second -1 [ s~ ^-Trans¬ 
lator’s note. 



Show that the spectrum of the train is 


Ss(cd) = S 0 (co) 


1 — exp [ — j(n + l)coT] 
1 — exp( — jcoT) 


where S 0 (cd) is the spectrum of a single 
pulse. 

Hint : Use the formula for the summation 
of a geometrical progression 


n 




1 — r n+1 
1 -r 


9. The train consists of three identical 
5-impulses as shown in the figure 


A AHt) 


-TOT 

Show that the frequency dependence of the 
magnitude of the spectrum of the train is 
given by the formula 

I Sz (co) | = [(1 + cos co T+ cos 2 cdT) 2 
+ (sincDT+ sin2cDT) 2 ] 1/2 

10. The accompanying figure shows the 
waveform of a pulse signal formed by 
segments of a harmonic oscillation. 



Prove that the spectrum of the signal is zero 
both at the zeroth frequency and at the 
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carrier frequency. How will the spectrum of 
the signal change, if its waveform is 



11. Using the convolution theorem, find 
the signal for which the Laplace transform is 

F(p) = U 0 /(p + a ){p + p) 

Advanced Problems 

12. Let there be a periodic signal 
described by a time function with jumps in 
level (discontinuities of the 1st kind). Show 
that, as their order increases, the Fourier 
coefficients of the signal have an asymptotic 
behaviour of the form 0{\/n), irrespective of 
the form of the function. 

13. Assuming the conditions of the 
previous problem, consider a signal in which 
the first derivative experiences 
discontinuities, whereas the function is 
continuous. Show that the Fourier 
coefficients have an asymptotic behaviour of 
the form 0(\/n 2 ). 

14. Discuss the following “paradox”: If 


we close for some time the switch in the 
circuit shown in the accompanying figure 



a rectangular pulse ur ( t ) will develop across 
the load resistor. This pulse is a sum of the 
harmonic components existing at all times, 
including the time prior to the occurrence of 
the pulse. How does this agree with the 
assumption that no pulse may be produced 
although the harmonic components exist 
already? 

15. Using the Fourier transform, find the 
integral representation for the derivatives of 
any order of the delta function. 

16. Show that the spectrum of the 
cr-function (see Eq. (2.43)), when it is 
represented by the inverse Fourier 
transform, yields at time 1 = 0 a signal a (0) 
whose value is 1/2. 

Hint : Take the frequency cd as a complex 
variable and evaluate the integral 

1 00 

- j [TC5(CD) + l//CD]dCD 

271 

by the theory of residues. 





































Chapter 3 

Power Spectra of Signals. 
Principles of Correlation Analysis 


The representation of signals in terms of their spectra markedly 
simplifies the computation of signal energy and, what is more 
important, makes it possible to interpret the results in an 
easy-to-grasp form. These physical ideas are useful in various 
theoretical and applied fields of telecommunications. This chapter 
will examine the relations between the spectral and power 
characteristics of signals. 

3.1 Cross-Spectral Density. Power Spectrum 

In Chap. 1 we have introduced a fundamental characteristic of 
a system of two signals, u(t) and v(t\- their scalar product 

(u, v)= j u(t)v(t)dt (3.1) 

— 00 

which is proportional to the cross energy of the signals. If the 
signals are identically the same, u(t) = v(t\ their scalar product 
changes to the signal energy 

00 

E u = (u , u) = J u 2 (t)dt (3.2) 

— 00 

Let us establish the relation between the scalar product of signals 
and their spectra. 

The generalized Rayleigh formula. Assume that the two signals, 
u(t) and v(t), appearing in Eq. (3.1) are defined in terms of their 
spectra 

u (t) = —— f S u (oo) exp (/cot) dco 

2ft — oo 

(3.3) 

1 00 

p (£) = —— | St, (co) exp (/cot) dco 

_ oo 

On substituting v(t) from (3.3) into (3.1) and reversing the order 
of integration with respect to time and frequency, we get 

J 00 oo 

(u, v) = —— J dcoSt,(co) J u(t) exp (/cot) dr 

2ft — 00 — 00 

Note that the inner integral in the last equation is the spectrum 
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of the signal u(t) as found for the negative value of the argu¬ 
ment: 

00 

j u(t)exip(jtt>t)dt = S u ( — cd) 

— 00 

In our further discussion we shall assume that the signals in 
question are described by real functions of time. Then, as is easy to 
see, 


J. W. Strutt (Lord 
Rayleigh, 1842-1919), 
an outstanding British 
physicist known for his 
work on the theory of 
waves and oscillations 


(u, v) = 2- J Sv (CO) S*u (oo) dco (3.4) 

^ft — oo 


The above relation is called the generalized Rayleigh formula. It can 
be interpreted in a form which is easy to memorize: The scalar 
product of two signals is proportional to the scalar product of their 
spectra. 

Of course, the order of complex conjugation in Eq. (3.4) may be 
reversed to give 


This is also known as 
Parseval’s relation 


▲ 

Work Problem 1 

Su (- oo) S% (- oo) = S*u (oo) Sv (oo) = [Su (to) S*„(co)]* 

Since for any complex number z 

z + z* = 2Re z 

we may introduce a real function 

Wus(flo) = Re [S« (co) S% (to)] (3-6) 

in terms of which the scalar product of the signals u and v may be 
written as follows: 


(u, v) = f- ] S u (co)S*(co) dco (3-5) 

2ft — oo 

In the general case, the integrands in Eqs. (3.4) and (3.5) are 
complex, although the left-hand sides of the equalities are known to 
be real. The two equations can be re-arranged so that the real 
function of frequency appears under the integral. The point is that 
the integration is carried out between symmetrical limits and the 
integrands corresponding, to two symmetrical points, ±co, are 
complex conjugates. To demonstrate, 


(u, v) = — f Wuu(co)dco 

2ft — oo 


The cross-power spect¬ 
rum 


— 00 


(3.7) 
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The amplitude respo¬ 
nse of an orthogonali- 
zing filter as a function 
of frequency 


The function W uv {®) is termed the cross-power spectrum * of the 
signals u and v. 

Equation (3.7) gives a deeper insight into the fine structure of the 
relation between the two signals. For one thing the various portions 
of their spectra contribute, in the general case, differently to the 
cross-power of the signals. The contribution is a maximum from the 
frequency intervals where the spectra overlap. For another, the 
generalized Rayleigh formula (3.7) suggests how the association 
between the signals can be minimized so that they become ortho¬ 
gonal in the limit. To achieve this, one of the signals must be 
matched to a special physical system called the frequency filter. This 
filter is to meet the following requirement: It may not pass those of 
the spectral components of the signal which lie within the frequency 
interval where the cross-power spectrum is a maximum. The fre¬ 
quency response of this orthogonalizing filter has a sharply defined 
minimum within that frequency interval. 

The above approach to finding the scalar product, based on the 
concept of the cross-power spectrum, is directly related to the 
results obtained in Chap. 1, when we found the scalar product of 
signals expanded in terms of orthogonal basis elments. The 
difference is that now we use the continuous rather than discrete 
Fourier presentation. 


Example 3.1. The cross-power spectrum of two exponential video 
pulses of the same waveform, separated by a time interval t 0 . 

Assuming that the two pulses have the same amplitude, their 
spectra may be written as follows: 

u ( t ) = exp (— at) a(t) 



+->S U ( co)= l/(a+;co) 

v(t) = Qxp[ — a(t — t 0 )]a(t— t 0 )<-+S v ((o) 


= exp( —j(ot 0 )/(a + 7 'co) 

Then we find the product of the spectra: 
Su(to)S* v (to) = exp(/cot 0 )/(a 2 + co 2 ) 


* Some authors (e. g. A. Breipohl, Probabilistic Systems Analysis) call it 
the cross-power density spectrum. Others (Middleton [20]) call it the 
cross-spectral density-Translator's note. 
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and, finally, the cross-power spectrum 

W uv (co) = cos cot 0 /(a 2 + co 2 ) ( 3 . 8 ) 

If we assign a fixed value to the parameter a which defines the 
waveform of the signals, the frequency behaviour of the cross-power 
spectrum will be wholly dependent on the time shift between the 
signals. Two typical plots for the function W uv ( co) appear in 
Fig. 3.1. 



Fig. 3.1 Cross-power spectrum of two exponential video pulses: (a) for 
at 0 »l; ( b ) for at 0 «l 



Orthogonalization of 
pulses 


Of special interest is the case where the product at 0 is small, that 
is, when the pulses substantially overlap in time. Equation (3.8) and 
the plot in Fig. 3Ab show that the cross-power spectrum has 
a well-defined low-frequency character. Hence we may conclude: In 
order to reduce the scalar product of such signals and to make 
them better resolvable, use should be made of a high-pass filter 
which suppresses all frequencies below some limiting, or cut-off, fre¬ 
quency, w c . 

Due to the action of a high-pass filter, the rapidly changing 
leading edge of the output pulse is produced by the high-frequency 
spectral components which are free to pass through. At the same 
time, the low-frequency components are filtered out and the 
duration of the output pulse is reduced substantially. As a result, 
the overlap of the pulses can be made as small as we like, and the 
pulses appearing at the output of the high-pass filter are orthogonal 
very nearly. 


The power spectrum of a signal. The spectral representation of 
signal power can readily be developed as a special case of the 
generalized Rayleigh formula, if we deem the signals u(t) and v(t) to 
be the same. Then Eq. (3.6) defining the cross-power spectrum takes 
the form 


Wu (co) = Su (co) 5 % (co) =|S w (co)| 2 


(3.9) 
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Part One. Signals 


The power spectrum 
The Rayleigh formula 


The quantity W u ((o) is called the power spectrum of a signal*. 
Then Eq. (3.7) may be re-written as 

E u = J u 2 dt = -^- 1 ^ u (co)dco ( 3 - 10 ) 

-00 271-00 

The relation defined in Eq. (3.10) is known in various fields of 
physics as the (narrow-sense) Rayleigh formula. It states an 
important result: The energy of any signal may be represented as 
a sum of contributions from various intervals on the frequency axis. 
Each small interval of physical frequencies, Aco, makes 
a contribution to the total signal energy, equal to 


A£ u = (l/7t)WM®')d® 


Work Problems 3 and 

4 


where co' is some interior point in a given frequency interval. 

(Positive frequencies are meant.) 

The approach based on the spectral representation of signal 
energy is relatively simple. Indeed, the energies associated with the 
various intervals on the frequency axis can be added together as 
real numbers. In contrast, the Fourier transform method as applied 
to the signals themselves is based on the fact that the complex 
amplitudes defining the contributions from small frequency 
intervals are added together as complex numbers. 

When we analyse signals on the basis of their power spectra, we 
inevitably lose the information embedded in the phase spectrum 
because the power spectrum, Eq. (3.9), is the square of the magni¬ 
tude of the spectrum and is independent of its phase. Among other 
things when presented in terms of power spectra, all signals having 
the same waveform but differing in their position on the time axis 
appear completely identical and undistinguishable. 

Yet the concept of the power spectrum is very useful m 
estimating the real bandwidth of a signal for engineering purposes. 


Example 3.2. The power spectrum of a rectangular video pulse. y 
To obtain it, we should square the spectrum of (2.20): 


VF u (oo) = U 2 Xp 


sin 2 (cotp/2) 

(wxp/2) 2 


(3.11) 

0 Xp 


* This quantity is also called the spectral density (Helstrom, Statistical 
Theory of Signal Detection. Oxford: Pergamon Press, 1968), the energy (or 
power) density (D. Middleton, An Introduction to Statistical Communication 
Theory. New York, Toronto, London: McGraw Hill Book Co., Inc., I960), 
the power density spectrum (Handbook of Automation, Computation an 
Control ed. by Eu.M. Grabbe, S. Ramo, and D.E. Wooldridge New York: 
John Wiley and Sons, Inc., 1958), the power spectral density (W.C. Lindsey 
and M K Simon, Telecommunication Systems Engineering, Englewood 
Cliffs, New Jersey: Prentice-Hall, Inc., 1973), etc.- Translator’s note. 
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Fig. 3.2 The normalized power spectrum of a rectangular video pulse as 
a function of the nondimensional frequency variable cox p 

The corresponding plot appears in Fig. 3.2. It is clearly seen that 
the power spectrum of the signal is a maximum in the low-fre¬ 
quency region. As the frequency rises, the contributions from the 
various spectral components show a non-monotonic, oscillatory 
behaviour, but the general trend is the decrease in the power 
spectrum in inverse proportion to the square: 

W u {(o) = O(l/co 2 ) as co tends to infinity 

(rather than in inverse proportion to the first power, as is the case 
with the spectrum of the signal in question). 

Formula (3.11) can be used to verify the Rayleigh formula. To 
begin with, we readily find the energy of the video pulse in the time 
domain (see Chap. 1): 

E U =U\ (3.12) 


In order to find the energy in the frequency domain, we should 
evaluate the integral: 

(3.13, 

o U> Tp/^f 

A simple change of variable leads to Eq. (3.12) at once. 


Energy distribution in the spectrum of a rectangular video pulse. 
It is interesting and, in many applied cases, important to know the 
share of the total energy within one, two, three, etc. lobes of the 
spectral diagram shown in Fig. 3.2. Let E ( k) denote the energy of 
a rectangular video pulse, contained in a number k of consecutive 
lobes. By the Rayleigh formula, 

kn 

E (k) = (2/n) U\ J sin 2 d£, 

0 


(3.14) 
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Part One. Signals 



Solve Problem 5 


Unfortunately, the above integral cannot be evaluated analytically, 
but can be found by numerical integration. The accompanying 
table, 3-1, gives the share of the total energy in the consecutively 
numbered lobes, as found by calculation. 


Table 3-1 


k 

1 

2 

3 

E(k)/E 

0.902 

0.950 

0.967 


Thus, if we apply a rectangular pulse to an ideal low-pass filter 
which passes uniformly and without attenuation all frequencies 
from 0 to 2tc/t p s' 1 (the boundary of the first lobe), the output 
signal will account for 90.2% of the input energy. 

As already noted, this approach to estimating the actual 
bandwidth of a signal does not give proper insight into the process. 
Among other things, we know nothing about the corruption that 
the signal suffers as it passes through. However, in cases where the 
shape of an oscillation is of secondary importance, and we are, 
above all, interested in the magnitude of signal energy (this 
situation is frequently encountered in statistical communication 
theory), the estimation of the bandwidth in terms of energy is 
especially warranted. 

For example, from Table 3-1 it is seen that in gomg from k =1 
to k = 2 (which implies a two-fold increase in the bandwidth of the 
device through which the signal is passed) the energy of the wanted 
signal increases by a mere 4.8%. On the other hand, it is clear that 
noise, if there is any, may, as a result, double in energy if its power 
spectrum is flat over the frequency band of interest. That is why an 
unwarranted increase in bandwidth must be avoided. 


3.2 Correlation Analysis of Signals 

In the early days of telecommunications, the choice of the best 
signals for specific applications was not critical. For one thing, the 
messages (telegraph signals, radio broadcasts) were simple in struc¬ 
ture. For another, it was difficult to implement signals of complex 
waveforms and the associated equipment for their coding, 
modulation, demodulation, and decoding. 

Today, the situation is entirely different. In present-day 
telecommunication complexes, the choice of signals is dictated not 
by the technical convenience in their generation, transformation 
and reception, but, above all, by the ability to achieve the goals 
envisaged at the design stage in an optimal manner, that is, with 
the utmost efficacy, using suitable signals. In order to get an idea 
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about how the need arises in signals possessing some predetermined 
properties, let us consider the following example. 

Comparison of signals translated in time. Let us turn to 
a simplified description of how a pulsed radar measures range to 
a target. Here, information about the target is embedded in the 
magnitude of x, the time delay between the transmitted pulse and 
the received echo. Characteristically, both the transmitted signal, 
u ( t ), and the received signal, u(t — x), have identical waveforms for 
any value of time delay. In block-diagram form, the device designed 
to process radar signals in order to measure range may look like 
the one shown in Fig. 3.3. 

1 2 N 




Fig. 3.3 Set-up for measuring delay time 


The system consists of a set of elements which delay the 
transmitted “reference” signal for fixed time intervals x 1? x 2 , ..., 
xjv. The delayed signals are applied together with the received echo 
signal to comparators which generate an output signal only if the 
two input signals are identical. If we know the No. of the channel 
in which this event occurs, we can measure the time delay and, in 
consequence, the range to the target. 

The performance of the device improves progressively with the 
increase in difference between the transmitted signal and its echo 
translated in time. If the difference is negligible, an ambiguous 
indication may will occur, because signals will appear at the out¬ 
puts of several adjacent comparators at the same time. 

Thus, we have developed a qualitative idea about which signals 
may be taken as “well-behaved” for a given application. 

Now we will pass on to the exact mathematical statement of the 
problem at hand and show that all these matters have a direct 
bearing on the power spectra of signals. 

The autocorrelation function of a signal. In order to evaluate the 
degree of difference between a signal, u(t), and its time-translated 
replica, u(t — x), it is usual to resort to the autocorrelation function 























































Part One. Signals 

K u ( x) equal to the scalar product of the two signals: 


The properties of the 
autocorrelation func¬ 
tion 


00 

K u (x) = J u(t)u(t-x)dt 

— 00 


(3.15) 


In our further discussion, it will be assumed that the signal of 
interest is a pulse localized in time, so the integral of the form in 

(3.15) does exist. , , A 

It follows directly from Eq. (3.15) that at x-0 the 
autocorrelation function becomes equal to the signal energy. 


One of the simplest properties of the autocorrelation function is 
that it shows even symmetry: 

K u (x)=Ku(-x) (3 ’ 17) 


To demonstrate, if in Eq. (3.15) we change the variables, x-t t, 
then 

00 00 

j u(t)u(t-x)dt = J u(x + x)u(x)dx 

-00 

An important property of the autocorrelation function is that 
under any time shift x the magnitude of the autocorrelation function 
does not exceed the signal energy: 

\K u (x)\^K u (0) = E u (3J8) 

This fact is proved by directly using the Cauchy-Buniakovski 
inequality (about which we have learned in Chap. 1). 

|(u, u t )K II « HIM =e„ (3J9) 

To sum up, the autocorrelation function K M (x) is a symmetric 
curve with a central maximum which is always positive. Irrespective 
of the form of the signal u(t), the autocorrelation function may 
display both a monotonically decreasing and an oscillating behavi¬ 
our. 


Example 3.3. The autocorrelation function of a rectangular video 

P Figure 3.4 a shows a rectangular video pulse of amplitude U and 
of duration x p . It also shows the signal’s replica translated 
backwards in time for x seconds. The integral of (3.15) is evaluated 
here in a trivial manner, proceeding from a graphical construction. 
To demonstrate, the product u(t)u(t-x) is non-zero only within 
the time interval over which the superposition of the signals is 
observed. From Fig. 3.4a it is seen that this time interval is equal 
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Fig. 3.4 Finding the autocorrelation function of a rectangular video pulse 


to x p - | x |, if the shift does not exceed the duration of the pulse. 
For the signal in question, 


K u (x) = 


U 2 x p 



0, | x | > x p 


| x | < x p 


(3.20) 


Graphically, the function yields a triangle like that shown in 
Fig. 3.4b. The base of the triangle is twice the pulse duration. 

Example 3.4. The autocorrelation function of a rectangular radio 
pulse. 

Consider a radio signal of the form 



0, (t < - Xp/2) 

^ (r) = < U cos cot, (— Xp/2 < t < Xp/2) 

0, (t > xp/2) 

Since we know that the autocorrelation function has the property 
of even symmetry, we evaluate the integral in (3.15) by assuming 
that 0 < x < x p . Then 

Xp/2 

K u {x)=U 2 J cos cot cos co (t — x)dt 

— (Xp/2) + X 

Xp/2 

= ( U 2 /2) (x p - x) cos cox + ( U 2 IT) J cos (2cot - x) dt 

— (Xp/2) + X 

The last trigonometric integral is easy to evaluate, and we obtain 


K„(x) = (t/ 2 /2)(x p -|x| 


cos cox + 


sin 2co (x p — | x | 


(3.21) 


2co(x p — | x |) 

Naturally, at x = 0, K u (0) becomes equal to the energy of the 
pulse (see Example 1.9). Equation (3.21) defines the autocorrelation 
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Part One. Signals 


function of a rectangular radio pulse for all shifts x lying in the 
interval ( — ip < x < Xp). Obviously, if the magnitude of the shift 
exceeds the duration of the pulse, the autocorrelation function 
identically reduces to zero. 

The autocorrelation function of the pulse in question has 
a characteristic oscillatory form. 

Example 3.5. The autocorrelation function of a train of rectangular 
video pulses. 

Radar widely uses signals which are trains of identical pulses 
recurring at equal time intervals. The task of detecting such a train 
and of measuring its parameters, such as its time position, is 
accomplished by devices which implement the algorithm for the 
computation of the autocorrelation function of the signal. 

As an example, Fig. 3.5 a shows a train of three identical 
rectangular video pulses. It also shows its autocorrelation function 
found by Eq. (3.15) (Fig. 3.5b). 



Fig. 3.5 (a) A train of three identical video pulses and (b) its 
autocorrelation function 


We omit all computational details because the procedure is 
exactly the same as used in Example 3.3. 

It is well seen that the autocorrelation function has a maximum 
at x = 0. However, when the delay time is a multiple of the pulse 
repetition period (x = + T, + 2T in our case), the plot of the 
autocorrelation function displays side lobes comparable in height 
with the main lobe. Therefore, we may speak of a certain 
imperfection in the correlation structure of the signal. 


▲ 

Work Problem 8 


The autocorrelation function of an unbounded signal. In cases 
involving periodic sequences extended in time without bound, 
a somewhat different approach is necessary towards the correlation 
properties of signals. Assume that such a sequence is derived from 
some signal localized in time, that is, a pulse signal, when its 
duration x p goes to infinity. 

To avoid discrepancy in the expressions thus derived, we shall 
define the new autocorrelation function as the mean of the scalar 
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product of the signal and its time-shifted replica: 

1 t p/2 

K u ( t)= lim — 1 u(f)u(t-x)dt (3.22) 

Tp^oo T P -V2 

With this approach, the autocorrelation function K u becomes 
equal to the mean cross power of the two signals. 

If we wish to find this autocorrelation function for a cosine 
waveform unbounded in time 
u (t)= U cos cot, —co<t<co 

we may use Eq. (3.21) derived for a radio pulse of duration ip , then 
pass to the limit with x p tending to infinity, and recall the definition 
in (3.22). As a result, we obtain 

K„(x) = (t/ 1 2 /2)coscox (3-23) 

This autocorrelation function is itself periodic; its value for x = 0, 
equal to U 2 /2, is the mean (effective) power that a given signal will 
develop across a load resistor of 1 £2. 

Relation between the power spectrum of a signal and its 
autocorrelation function. From the material presented in this 
chapter, the student may think that the methods of correlation 
analysis are only some special techniques which have no direct 
bearing on the principles of a spectral decomposition. It is easy to 
show that there is a close relation between the autocorrelation 
function and the power spectrum of a signal. 

To demonstrate, in accord with Eq. (3.15), the autocorrelation 
function is a scalar product: 

K u (x) = (u, Ur) 

Here u x stands for u(f-x)‘which is a time-shifted replica of the 
original signal. 

Referring to the generalized Rayleigh formula, Eq. (3.4), we may 
write 

(u, u x ) = | S„(co)S* t (cD)dco 

The spectrum of a signal shifted in time is 
S« T = S„exp(—jcox) 

Therefore, 

S* = S* exp (/cox) 

This brings us to an important result: 

1 00 

Ku(t)=— J I Su | 2 exp(/cox)dco 
2n 


— 00 


(3.24) 
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Part One. Signals 


Relation between the 
autocorrelation functi¬ 
on and power spectrum 
of a signal 


As will be recalled, the square of the magnitude of the spectrum 
is the power spectrum of a signal. Thus, the power spectrum is the 
Fourier transform of the autocorrelation function of a signal: 

iC„(T)^|S u (co)| 2 = Wu(fa) (3.25) 

Using Eq. (3.24), we may write the inverse relation 


00 

|S„(co)| 2 = j X u ( t) exp(— ycor)dr 

— 00 


(3.26) 


The above expressions are important for two reasons. Firstly, 
they permit us to evaluate the correlation properties of signals from 
the distribution of their power over the spectrum. According to the 
uncertainty principle (see Chap. 2), an increase in the frequency 
band within which the spectral components of a signal are 
distributed produces a narrower main lobe of the autocorrelation 
function and makes the signal more manageable from the 
view-point of measuring the instant when it occurs. Secondly, Eqs. 
(3.24) and (3.26) suggest the way in which the power spectrum of 
a signal can be determined experimentally. Frequently, it is more 
convenient first to find the autocorrelation function, and then to 
derive the power spectrum of a signal from its Fourier transform. 
This procedure is widely used in the analysis of signals with the aid 
of high-speed computers operating in real time. 


Example 3.6. The autocorrelation function of a signal with 
a uniform and band-limited power spectrum. 

Let the signal u(t) be characterized by a power spectrum of the 
form 

JO, (0 < - co lim 
PE„(co) = < W 0 , - co, im < (0 < co lim 

(0, © > a>i im 

Using Eq. (3.24), we find the autocorrelation function: 

®lim 

K u (t) = ( W 0 /2n) j exp (/cox) dco 

®lim 





® lim 

= ( W 0 /%) J COS CDX dco 
0 


PF 0 C 0 i im sinco lim x 


7U 


CD lim T 


(3.27) 
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Correlation time 


Thus, the autocorrelation function of the signal in question has 
a lobed structure. 

Frequently, it is convenient to introduce a numerical parameter 
known as the correlation time , x c , which is an estimate of the width 
of the main lobe of the autocorrelation function. It is easy to see 
that in the case at hand the correlation time should be found from 
the relation 


®lim X c — 71 

Hence, it follows that 

Xc = 7c/©lim = 1 /2/lim (3.28) 


decreases with an increase in the upper frequency limit of the power 
spectrum of the signal. 


Constraints imposed on the form of the autocorrelation function 
of a signal. From the relation existing between the autocorrelation 
function and the power spectrum of a signal we can establish an 
interesting, but, it seems, not so obvious criterion for the signal to 
have the desired correlation properties. The point is that the power 
spectrum W u ( co) of any signal must, by definition, be positive (see 
for example Eq. (3.25)). This condition is not satisfied with just any 
choice of the autocorrelation function. For example, if we choose 

{ 0 , x< -x c 
A, x c < x < x c 
0, x>x c 


▲ 

Work Problems 6 
and 7 




K u 



A 


T 


-T c 0 T c 


and take the Fourier transform, then we shall get 

| S u | 2 = 2A J cos cox dx = (2,4/co) sin cox c 
o 

This alternating function cannot represent the power spectrum of 
any signal. 



^0) 


3.3 The Autocorrelation Function of Discrete Signals 

From our discourse on the autocorrelation function of a train of 
rectangular video pulses, the reader has undoubtedly noted that its 
plot has a specific lobed structure. For practical uses of the 
autocorrelation function, such as the detection of this signal or the 
measurement of its parameters it is immaterial that the lobes are 
triangular in shape. What is important is their level as compared 
with the central maximum at x = 0. 

Our immediate task is to modify the autocorrelation function so 
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(a) 




u o 



-Un 




(b) 


(c) 


Fig. 3.6 A three-position discrete signal and its realization by variations in 
amplitude and phase: (a) symbolic representation; ( b) amplitude coding; (c) 
phase coding 

that we can extract from it all useful information while divorcing 
ourselves from minor details. A convenient basis for this endeavour 
is supplied by the mathematical model of a discrete signal (see 
Chap. 1). 

Representation of composite signals having a discrete structure. 

A train of identical rectangular video pulses is the simplest 
representative of the class of composite signals built in accordance 
with the following principle. The entire interval over which the 
signal exists is divided into a whole number M > 1 of equal 
intervals called positions. Within each position the signal may exist 
in any one of two physical states. 

Figure 3.6 explains several ways of forming a multiposition 
composite signal. For definiteness (here and elsewhere) we assume 
that the two possible states of the signal correspond to the numbers 
+ 1 and — 1. 

As follows from the figure, a discrete signal may take on different 
physical shapes. In the first case (see Fig. 3 .6b) the + 1 symbol 
corresponds to the positive value, + U 0 , of the height of the video 
pulse transmitted in the respective position, whereas the — 1 
symbol corresponds to the negative value of the pulse height, 
■ — U 0 . This is the amplitude coding of a discrete signal. 

Principles of discrete In the second case (see Fig. 3.6c), the signal is phase-coded. In 
signal coding order to transmit the + 1 symbol in the corresponding position, we 

generate a truncated harmonic signal with a particular (say, zero) 
initial phase. In transmitting the — 1 symbol, we utilize a truncated 
sine wave of the same duration and of the same frequency, but with 
the initial phase shifted through 180°. 

Despite the obvious difference between the waveforms of these 
two signals, we can establish a complete identity between them in 
terms of their mathematical models. To demonstrate, the model of 
any such signal is a sequence 

{iq, u 2 , ..., um- i, um} 

in which each symbol uj takes on one of two possible values, + 1 
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or — 1. For convenience, let us agree to stuff the sequence with 
zeros in the positions where the signal is not defined. Then, the 
discrete signal {1, 1, -1, 1} can be written out in full as 

...0 0 0 1 1 - 1 1 0 0 ... 

An important operation in processing discrete signals is the shift 
of such a signal through a certain number of positions (digits) 
relative to the original one. In what follows, the first line represents 
the original signal; the second, third and fourth lines represent the 
same signal shifted backwards one, two, and three digits: 


...0 0 011 1 1 0 0 0 0 ... 
...0 0 0 0111 1 0 0 0 ... 
...0 0 0 0 0111 1 0 0 ... 
...0 0 0 0 0 0 1 1 1 1 0... 


The discrete autocorrelation function. Let us generalize Eq. (3.15) 
so that we could determine the discrete counterpart of the 
autocorrelation function applicable to the class of signals in 
question. Obviously, integration should now be replaced with 
summation, and the variable x should be replaced with an integer n , 
positive or negative, which indicates how many positions (digits) the 
replica is shifted relative to the original signal. Recalling that we 
have agreed to stuff “empty” positions with zeros, the discrete 
autocorrelation function may be written as 


OO 

K u (n)= £ ujUj—n (3.29) 

j=-CO 


This formula is appli¬ 
cable to a discrete 
signal of the most gen¬ 
eral type 


This function of a whole-valued argument n extends to the 
discrete case the basic ideas of the scalar product of two signals 
and, quite naturally, possesses many of the already known 
properties of the scalar product and of the continuous 
autocorrelation function. For example, it is easy to see that the 
discrete autocorrelation function shows even symmetry: 

K u (n) = K u {-n) (3.30) 

Under a shift of zero, the discrete autocorrelation function 
reduces to the energy of a discrete signal: 

00 

K u ( 0)= I I?- = E u (3.31) 

j = - 00 

Selected examples. To illustrate the foregoing, let us find the 
discrete autocorrelation function of a three-digit signal in which all 
the digits are the same, u = {1, 1, 1}. Let us write this signal along 
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with its replicas shifted one, two and three digits: 
...0 0 0 1 1 1 00 0 ... 

...0000 1 1 1 00 ... 

...0000 0 1 1 1 0 ... 

...0 0 0 0 00 1 1 1 ... 


3 



3 




1 

T 

i 

T 

I 

1 . 


- 2-1 0 12 


As is seen, even with n = 3 the original signal and its replica do 
not overlap any longer. This implies that the products in Eq. (3.29) 
reduce to zero at n ^ 3. On taking the sums, we get 

X M (0)=1+ 1 + 1=3 
K u ( 1)= 1 + 1=2 
K u (2) = 1 

The side lobes of the autocorrelation function here subside with 
increasing number n in about the same manner as we have seen in 
the case of the autocorrelation function for three continuous video 
pulses. Obviously, one and the same discrete autocorrelation 
function can fit a wide variety of sequences derived from any 
continuous signals, provided the time spacing between the pulses is 
the same. 

Now we consider a discrete signal which differs from the previous 
one in the sign in the second position: 

u={ 1, -1, 1} 

Proceeding as before, we find the values of the discrete 
autocorrelation function: 

(0) = 1 + 1 + 1 = 3 
K u ( 1)= -1-1= -2 


-2 


K u ( 2 )= 1 

It turns out that the first side lobe changes sign, but remains 
unchanged in magnitude. 

Finally, let us consider a three-position discrete signal for which 
the mathematical model is: 


3 




1 

T 

1 

T 

I 0 

0 l 

1 1 

i 1 n 


- 2-1 0 1 2 


«= {1, 1,-1} 

Its autocorrelation function is: 

K u (0) = 1 + 1 + 1 = 3 

K u ( 1)= 1 — 1 =0 
K u ( 2)=1 

Undoubtedly, of the three discrete signals we have just examined, 
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it is the third one that is most favourable in terms of correlation 
properties, because the side lobes of its autocorrelation function 
have the lowest level. 

Barker sequences. In the 50s and 60s, the search for discrete 
signals whose autocorrelation function would have the best struc¬ 
ture was the object of intensive research by specialists in the fields 
of communication theory and applied mathematics [21]. They have 
found several classes of signals having very good correlation 
properties. Of them, the so-called Barker sequences are most 
known. They possess a unique property: Whatever the number 
M of positions (digits or pulses), their autocorrelation functions, as 
found by Eq. (3.29), do not exceed unit for any n ^ 0. On the other 
hand, their energy, that is, K u ( 0), is numerically equal to M. 

It has been found that Barker sequences can be realized only if 
the number of digits (that is, the length) is M = 2, 3, 4, 5, 7, 11, or 
13. M — 2 represents a trivial case. The Barker sequence with M = 3 
has just been examined at the end of the previous section. The 
mathematical models of Barker sequences and the corresponding 
autocorrelation functions are summarized in Table 3-2. 


Table 3-2 Barker Sequences 


M Signal model 


Autocorrelation function 

3 

i, 

i. 

_ 

1 



3, 0 , - 

1 


4 

i, 

i, 

1, 

— 

1 


4 , 1 , 0 , 

-1 



i. 

i. 

— 

1 , 

1 


4 , - 1 , 

0, 1 


5 

i. 

i. 

1 , 

— 

1, 

i 

5 , 0 , 1 , 

0, 1 


7 

i, 

i, 

1, 

— 

1 , 

-i,i, -i 

7, 0 , - 

1 , 0 , - 1 

, 0,-1 

11 

i, 

i, 

1 , 

— 

1 , 

-i, -i, 

11 , 0, - 

- 1 , 0 , - 

1, 0, - 1, 


i, 


1, 

— 

1 , 

i,-i 

0, -1, 

o , -1 


13 

i, 

i, 

1, 

1 , 

1, 

-i, -i, 

13, 0, 1 

, 0, 1, 0, 

1 , o , 


i. 

i, 

— 

1, 

1, 

-i, i 

1 , 0, 1, 

0, 1 



With M = 4, two 
forms of signals are 
possible 



— U-U-U-U-Ui© 

-12-10-8-6-4-2 


13 


_1_ 

.# i# L© L_^ 

0 2 4 6 8 10 12 


(c) 


Fig. 3.7 Barker sequences for M=13: (a) amplitude coding; (b) phase 
coding; (c) autocorrelation function 
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As an illustration, Fig. 3.7 shows the form of the most commonly 
used 13-digit Barker sequence and two coding methods along with 
a plot of its autocorrelation function. 

As investigations have shown, Barker sequences with an odd 
number of digits exceeding 13 are non-existent. It remains 
A unknown, however, whether we can build a Barker sequence with 

Solve Problem 9 an even M greater than four. 

In conclusion, it should be noted that in this chapter we have 
examined some properties of discrete signals and of their 
autocorrelation functions by way of an introduction. A systematic 
exposition of the material will be given in Chap. 15. 


3.4 The Cross-Correlation Function of Two Signals 

In some theoretical and applied problems of telecommunications 
it is convenient to introduce a special characteristic of a two-signal 
system, the cross-correlation function between the signals involved. 
It describes in a unified manner both the difference in shape and 
the relative position of the signals on the time axis. 

Determination of the cross-correlation function. By generalizing 
Eq. (3.15), let us call the cross-correlation function between two 
real signals, u(t) and v(t), the scalar product of the form 
00 

J u(t)v(t-x)dt (3.32) 

— 00 

The usefulness of this integral characteristic of signals will be 
seen from the following example. Let, for instance, the signals u(t) 
and v(t) be orthogonal in their original state, so that 

00 

J u(t)v(t)dt = 0 

— oo 

As they pass through a device, the signal u(t) may lead or lag 
behind the signal v(t) by a time interval r. Obviously, the 
cross-correlation function K uv ( r) is a measure of how “stable” the 
orthogonal state of the signals is under the time shift. 

Some properties of the cross-correlation function. If in Eq. (3.32) 
we change the variable of integration i, = t — x, such that dt = d^, 
the cross-correlation function may obviously be re-written thus: 
00 

K uv ('t)= J u{% + x)v(^)d^ (3.33) 

The reason why the results found by Eqs. (3.32) and (3.33) are 
the same is clear: The signals u(t ) and v(t) will take up the same 
relative position, whether we shift the signal v(t ) backwards or 


Ch. 3 Power Spectra of Signals 


97 


advance the signal u(t) by the same amount x. Therefore, 


Kuv(x) = K vu (-x) (3.34) 

In contrast to the autocorrelation function of one signal, the 
cross-correlation function between two signals does not show even 
symmetry about the argument x: 

Kuv(t) 7 ^ Kuv( — X ) 

If we consider signals of finite energy, we will see that the 
cross-correlation function is bounded. This statement follows from 
the Cauchy-Buniakovski inequality: 

| Kuv(t) \ = \(u, V X ) I ^ II u II ■ II Vx II. 

Hence, 

|K U! >(t)K || MII - II r|| (3.35) 

because the shift in time does not affect the norm of the signal. It 
should be noted that at x = 0 the cross-correlation function need 
not reach an absolute maximum. 


u(t) 



Example 3.7. Calculate the cross-correlation function K uv ( x). 
The signal u{t) is a rectangular video pulse, and the signal 
v(t) is a triangular video pulse. They have the same amplitude, U, and 
the same duration, T. Originally (in the absence of delay), the signals 
exist over a common time interval [0, T], 

For (0<t< T), the signals can be written: 

* 

u(t)=U and v(t)=Ut/T 

If x>0, that is, if the signal v(t) lags behind the signal u(t), then 
T 

K uv (T) = (U 2 /T)$(t-x)dt 
o 



0 T T 

Case x >0 


On introducing a dimensionless parameter r| = x/T and carrying 
out simple manipulations, we get 

K uv {x)= C/ 2 T^y—q + yT| 2 ^ for x>0 (3.36) 

If, on the other hand, x < 0, that is, the triangular pulse leads the 
rectangular pulse, then 

t - | x | 

K uv (x) = (U 2 /T) j (l — | x |)dt = (t/ 2 T/2)(l - r| 2 ) (3.37) 

0 

The cross-correlation function as found by Eqs. (3.36) and (3.37) 


4-728 
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K u J(U 2 T) 



Case t < 0 


Fig. 3.8 A plot of the cross-correlation function between a rectangular and 
a triangular pulse 


is shown diagrammatically in Fig. 3.8. The plot is asymmetrical, 
because the overlapping area of the two pulses varies at a different 
rate, depending on the direction of the time shift. 

Relation to the cross-power spectrum. Let us express the 
cross-correlation function between two signals in terms of their 
spectra. In doing this, we will apply the same reasoning as in the 
spectral representation of the autocorrelation function. On the basis 
of the generalized Rayleigh formula 
00 

K uv {t) = (u, v x ) = (1/2jc) J S u (co) (co)dco 

— 00 

Since the spectrum of the time-shifted signal is 
S v (co) = S v (co) exp (- j cox) 
it follows that 

00 

K uv (z) = (l/2rc) j S u (co) Si? (co) exp (/cox) dco (3.38) 

— 00 


Recalling that 

W uv (t) = S u (co) S * (co) (3.39) 

is the cross-power spectrum of the signals u(t) and v(t), defined 
over an infinite frequency interval — oo < co < oo, we may draw the 
following conclusion: The cross-correlation function of two signals is 
the Fourier transform of their cross-power spectrum , and vice 
versa. 

Interestingly, in contrast to the power spectrum of a single signal, 
the cross-power spectrum contains some information about the 
phase of the spectral components at different frequencies. Thus, if 
the signal spectra are 

S u (co) = I Su (co) I exp; \|/„ (co) 

S v (co)= \S v {(o)\Qxpjy\f v ((o) 
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then, on the basis of Eq. (3.39), the argument of the cross-power 
spectrum is defined in terms of the difference between the 
arguments of the spectra of the signals: 

Wuv (co) = |S M (co)| X |S„(co)| exp {j [i|/ M (co) - x)/^ (co)]} 

Generalization to the discrete case. Let the signals u(t) and v(t) 
be specified in discrete form as sets of samples 

w= {..., «_!, u 0 , u lf u 2 , ...} 
v= {..., v_ lt v 0 , v lf v 2 , ...} 

recurring at equal intervals T. By analogy with the autocorrelation 
function of a single signal, the cross-correlation function of two 
discrete signals may be defined by the formula 


00 

Kuv(n)= X UjVj—n 
7= - oo 


(3.40) 


where n is an integer, positive, negative or zero. 

We will demonstrate how this function is calculated, using as an 
example two four-digit Barker sequences 

"={ 1 , 1 , 1 , - 1 } 

»={ 1 , 1 , - 1 , 1 } 

If n > 0, the signal v lags behind the signal u. Proceeding as in 
the previous section, we compile a table of the signal u and a set of 


time-shifted replicas of the signal v: 

...0 0 0 0 t 1 

1 -1 

0 

0 0 0 0. 

...0 0 0 0 11- 

-1 1 

0 

0 0 0 0. 

...0 0 0 0 0 1 

1 -1 

1 

0 0 0 0. 

...0 0 0 0 0 0 

1 1 

-1 

1 0 0 0. 

...0 0 0 0 0 0 

0 1 

1 

- 1 1 0 0. 


Using Eq. (3.40), we obtain 

K uv ( 0 ) = 0 

K uv ( 1) = 3 
Kuv( 2) = 0 
Kuv( 3)= -1 

A similar table can be compiled with the signal v(t) shifted so 


The cross-correlation 
function of discrete 
signals 


The cross-correlation 
function of two Barker 
sequences 


4 * 
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that it leads the signal u(t): 

...0 0 0 0 1 1 1 - 1 0 0 0 ... 

...0 0 0 0 1 1 - 1 1 0 0 0 ... 

...0 0 0 1 1 - 1 1 0 0 0 0 ... 

...0 0 1 1 - 1 1 0 0 0 0 0 ... 

...0 1 1 - 1 1 0 0 0 0 0 0 ... 

Then, 

Kuv(- 1)=1 
K uv (- 2) = 0 
K uv ( — 3) = 1 

The plot of the cross-correlation function of these two signals has 
a sharply asymmetric shape: the cross-correlation function is at 
a maximum when the signal v(t) is shifted one digit backwards. 

Summary 

oo The scalar product of two signals may be expressed as the scalar product of their 
spectra (the generalized Rayleigh formula). 

oo The distribution of the cross power over a frequency range is described by the 
cross-power spectrum of the two signals involved. 

OO An approximate orthogonality of signals can be achieved by filtering out appropriate 
spectral components. 

OO From the distribution of the signal energy over the entire infinite frequency interval it 
is seen that its power spectrum is equal to the square of the magnitude of its 
spectrum. 

oo The degree of semblance between a signal and its time-shifted replica is described by 
the autocorrelation function of that signal. 

The power spectrum and the autocorrelation function of a signal are related by 
a Fourier transform pair. 

oo The notion of the autocorrelation function can be extended to the case of 
multiposition (multidigit) discrete signals. 

It is taken that a signal has good correlation properties if the side lobes of its 
autocorrelation function are substantially smaller than the main lobe. 

OO The cross-correlation function of two signals is the Fourier transform of their 
cross-power spectrum. 


3 


1 1 

1 0 1 

3 n 

-3-2-1 0 1 

2 1 


-i 


A 

Work Problem 10 


Review Questions 

1. What is the physical meaning of the cross-power spectrum of two signals? 

2. Name the conditions that should be satisfied by the function describing the cross-power 
spectrum of two signals so that the signals involved could be orthogonal. 
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3. Is it possible to realize a situation in which the spectra of two signals overlap, but the 
signals remain orthogonal? 

4. Is the phase of the spectrum of a signal important in determining its power spectrum? 

5. Can two nonidentical signals have the same power spectrum? 

6. How much of the total energy of a rectangular video pulse does the main (first) lobe of 
the spectral diagram contain? 

7. What are the physical grounds for introducing the autocorrelation function? 

8. List the principal properties of the autocorrelation function. 

9. What should the power spectrum be for a signal whose autocorrelation function has 
a narrow main lobe? 

10. Define the constraints that can be imposed on the form of the autocorrelation function 
of a physically realizable signal. 

11. What is the basic principle underlying the construction of a multiposition (multidigit) 
discrete signal? 

12. How do we introduce the discrete autocorrelation function of a multiposition signal? 

13. Name the main property of Barker sequences. What is the advantage of these sequences 
over other possible multipulse signals? 

14. Can we realize Barker sequences with any number of positions (digits), however large? 


Problems 

1. Prove that if u(t) and v(t) are real 
signals, then the imaginary part of the 
product S u ((o)S${(£>) is an odd function of 
frequency. 

2. Analyse the cross-power spectrum of 
tv/o identical rectangular video pulses shown 
in the accompanying diagram 



^0 


U(t) 


V(0 

t 


*0 




depending on the time shift t 0 between 
them. 

3. Derive an expression describing the 
power spectrum of the exponential video 
pulse defined by 

u ( t ) = U 0 exp ( — cut) a (t) 

4. A Gaussian video pulse is defined by 
u(t)= U 0 exp( — 6 x 10 17 1 2 ) 


Determine the fraction of the total energy of 
the signal contained in the frequency range 
from 0 to 1.5 MHz. 

5. Find the effective bandwidth of the 
exponential signal of Problem 3, assuming it 
as a frequency band within which 90% of 
the total signal energy is contained. 

6. Prove that the autocorrelation 
function of the exponential video pulse from 
Problem 3 is defined by 

K u (r) = (C/g/oc)exp( - a| x |) 

7. Find the autocorrelation function of 
a signal s(t) whose spectrum is real and 
concentrated in the frequency interval [aq, 

ro 2 ]: 



|S| 



^0 








( 1 ) 


- 0>2 - 0>1 0 0> 1 0>2 


8. Calculate the autocorrelation function 
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of the triangular video pulse shown below: 


Vo 

U 

\ t 

0 Tp 


9. Find the autocorrelation function of 
the discrete signal {1, 1, 1, — 1, — 1, 1, 1}. 

Compare the result with the 
autocorrelation function of a seven-digit 
Barker sequence. 

10. Calculate the cross-correlation 
function of two Barker sequences with M = 
= 5 and M = 7. 


of taking on values -I-1 and — 1 with an 
equal probability. Generate the random 
numbers by tossing a coin. 

Investigate the resulting autocorrelation 
function by comparing it with that typical of 
Barker sequences. 

Go through the experiment once more for 
a sufficiently large number of digits (15-20). 
Suggest the likely approaches to 
implementing complex signals with good 
correlation properties in the case of a large 
number of digits. 

12. Find and analyse the cross-correlation 
function of two exponential signals 

w(f) = exp( - ai0 CT (0 

V(t) = exp( — OL 2 t)G(t) 


Advanced Problems 


for oq # a 2 . 


11. Analyse experimentally the auto¬ 
correlation function of a six-digit discrete 
signal in which all positions are capable 


Chapter 4 

Modulated Signals 


The baseband signals coming from a message source (a 
microphone, a TV camera, a telemetry transducer, and the like) 
cannot, as a rule, be transmitted by a communication channel 
directly. This is not only because the signals are small in amplitude. 
The more important factor is that they are relatively low in fre¬ 
quency. For such signals to be effectively transmitted through any 
medium with the aid of electromagnetic waves, their spectrum must 
be translated from the low-frequency (baseband) region into one of 
sufficiently high frequencies. This procedure, known as modulation 
in telecommunications, will be discussed in this chapter. 

4.1 Amplitude-Modulated Signals 

Before we take up this simplest form of signal modulation in 
more detail, it is worth while to discuss briefly some matters related 
to modulation in any form. 

The carrier. The rationale of the procedure by which the 
spectrum of a signal can be translated to higher frequencies is this. 
To begin with, the transmitter generates an auxiliary r.f. wave called 
the carrier. Its mathematical model 

Wcar(t) = /(t? # 1 ? a 2 , • ••> Clm) 

is such that we can single out a set of parameters (a 1 , a 2 , ..., a m ) 
which specify the carrier wave. 

Let s(t) be the baseband signal to be transmitted by 
a communication channel. If at least one of the parameters (a l9 a 2 , 
..., a m ) varies in sympathy with the baseband signal, the carrier 
acquires a new quality-it embodies the information originally 
contained in the baseband signal s(t). 

The physical process by which the parameters of the carrier are 
varied as desired is what we have called modulation. 

Communication systems widely use forms of modulation in 
which the carrier is a simple harmonic wave 

Wear (t) := U COS (cot + (p) ( 4 - 1 ) 

In this harmonic wave, we can vary any one of three independent 
parameters: the amplitude U, the angular frequency co, or the initial 
phase cp so that each follows variations in the baseband signal. 
Depending on which of the three parameters is changed, we can 
derive three forms of modulation. 

The principle of amplitude modulation. When the carrier 
amplitude U(t) is made to vary in sympathy with the baseband 
signal while the other two parameters, co and cp, remain unchanged, 


Modulation 
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An AM signal and its 
envelope 

• 

The envelope and the 
carrier 


The modulation factor 
(modulation depth) 


Most radio broadcast¬ 
ing systems operate by 
amplitude modulation 


we have what is called amplitude modulation. An amplitude-mo¬ 
dulated (AM) signal can be defined as 


UAM(t)= U (t)cos(co 0 t + (Po) 


(4.2) 


An AM signal has a specific waveform. Above all, it is 
symmetrical about the horizontal axis. In accord with Eq. (4.2), an 
AM signal is the product of the envelope U (t) and the harmonic 
carrier cos(oo 0 t + cp 0 )- I n most cases of practical interest the 
envelope varies much more slowly than the r.f. carrier. 

In amplitude modulation, the envelope U ( t ) and the modulating 
baseband signal s(t) are connected by a relation of the form 


U(t)=U 0 [l+Ms(t)-] (4.3) 


Here, U 0 is a constant factor defining the amplitude of the carrier 
with no modulation applied, and M is called the modulation factor , 
the depth of modulation (or modulation depth). The value of 
M defines the degree of amplitude modulation. The meaning of this 
term can be understood from reference to the waveforms of AM 
signals in Fig. 4.1. 


(b) (c) 

Fig. 4.1 AM signals for different depths of modulation: (a) low-level 
modulation; ( b ) high-level modulation; (c) overmodulation 

In the case of a small modulation depth, the relative change in 
the envelope is small 

|Ms(t)|«l 

at all times, irrespective of the waveform of the signal s(t). On the 
other hand, when the approximate equalities 

Ms max (t)^l or Ms min (t) « -1 
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are satisfied at instants when s(t) is at its extremal values, this is an 
indication of a large modulation depth. 

Sometimes, the modulation depth is expressed numerically as 
a percentage, and is then referred as the percentage modulation. This 
may be the upward percentage modulation 


M, 


up- 


Umax(0 ~ Uo 

u n 


x 100% 


or the downward percentage modulation 


M down = - U °~% lln(t) xlOQ% 
b'o 

It is not warranted to use AM signals with a small modulation 
depth in communication channels, because the power output of the 
transmitter is not fully utilized. In contrast, 100% upward 
modulation doubles the amplitude of the output wave at the peak 
values of the modulating signal. Any further increase in amplitude 
usually leads to undesirable distortion because the output stages of 
the transmitter are then overloaded. 

An excessive downward modulation is as detrimental. Refer to 
Fig. 4.1c which illustrates what is called overmodulation (Mdown > 
> 100%). Here the envelope ceases to follow the shape of the 
modulating signal. 

Single-tone amplitude modulation. The simplest AM signal is 
produced when the modulating baseband signal is a harmonic wave 
at a frequency Q. Then the resultant (modulated) signal 


UAM(t)= U 0 [1 -f M cos (Qt -f- O 0 )] cos(co 0 t + cp 0 ) (4.4) 


is called a single-tone AM signal. It is easy to see that single¬ 
tone amplitude modulation has the property of symmetry, that is, 

M U p = Mdown = M 

Let us see whether such a signal can be represented as a sum of 
simple harmonic waves. Using the trigonometric formula for the 
product of two cosines, we immediately obtain 


U AM (t)=U o cos (o> 0 r + Cp 0 ) + 


U 0 M 

2 


cos 


(co 0 + £2) t + cp 0 + O 0 


+ 


U 0 M 

2 


cos [(co 0 — Q)t + cp 0 — O 0 ] 


(4.5) 


▲ 

Solve Problem 3 


Overmodulation 


Equation (4.5) defines the spectral composition of a single-tone 
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AM signal. Here 

co 0 = carrier frequency 

© 0 + O = upper side frequency 

co 0 — Q = lower side frequency 


▲ In plotting the spectral diagram of a single-tone AM signal 

Work Problem 1 defined in Eq. (4.5), care should be above all taken that the upper 

and lower side frequencies are equal in magnitude and are arranged 
symmetrically about the carrier frequency. 

The power characteristics of the AM signal. A matter of interest 
is the distribution of power between the carrier and the side fre¬ 
quencies. The source of a single-tone AM signal is equivalent to 
a sum of three harmonic sources: 

Wear (t) ~ U 0 COS (C0 o t <Po) 

«us (t) = C0S LK + £2) t + (p 0 + <J> 0 ] 

Mis (0 = U °M cos [(ffl 0 - Q) t + (p 0 - 4> 0 ] 



For definiteness, let us deem that these are ideal voltage sources 
connected in series and loaded into a 1-ohm resistor. Then the 
instantaneous power in the AM signal will be numerically equal to 
the square of the total voltage 

p(t) = M^mW = M car ~b U us "b M ls *b ^ M car M us 

“b ^M car M[ s + 2u us u ls (4.6) 

Characteristically, Eq. (4.6) contains both the self-power of the 
sources and their cross-powers numerically equal to the pairwise 
products of instantaneous values. 

In order to find the average power of the signal, the term p(t ) 
must be averaged over a sufficiently long time interval T: 

1 7 

p= lun — jp(t)dT 

T-+ CO 1 0 

It can be easily verified that averaging would cause all 
components of the cross-power to vanish, so the average power of 
an AM signal is equal to the sum of the average powers of the 
carrier and the side frequencies: 

P = Pear + Pus + Pis = Uq/ 2 + UpM 2 /8 + UpM 2 /S 


(4.7) 
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Hence, we may write 


(Pus + Pls)/Pcar = M 2 /2 


(4.8) 


Thus, even in the case of a 100% modulation (M= 1), the total 
power in the two side frequencies is half that of the carrier. Since or 1 ro em 
the information being transmitted is embedded in the side fre¬ 
quencies, we may say that amplitude modulation is rather wasteful 
of power. 

Amplitude modulation by a complex wave. In practice, 
single-tone AM signals are used but seldom. More frequently, the 
modulating baseband signal is a complex wave. It is customary to 
use the following trigonometric sum as a mathematical model for 
such a signal: 

N 

s(t)= £ aiCos(Q/t + Of) (4.9) 

i= 1 

Here the frequencies Qj form an ordered, ascending sequence < 

<Q 2 < ••• <&N, whereas the amplitudes a; and the initial phases 
®i are arbitrary. 

Substituting (4.9) into (4.3) gives 

N 

u\M{t)= U 0 [\ + £ M oqcos(Q/t-I- <t>/)]cos(co 0 t + cp 0 ) 

i = 1 

Let us introduce the set of partial modulation depths 
Mi = M a / 

and write an analytical expression for a multitone AM 
a form which generalizes Eq. (4.4): 

N 

UAM(t)= U 0 [\ + £ MiCOs(Qir-hOi)]cos(o)o^4-(po) 

i= 1 

The spectral expansion is precisely the same as it is for 
a single-tone AM signal: 

N 


(4.10) 

# 

(4.11) 

Partial modulation 

signal in 

depths 

(4.12) 



UAM (t)=U 0 cos (g) 0 r + (p 0 ) -I- 


I 


U 0 Mj 

2 


cos [K 


Oj) t + (p 0 4- Of] + 


L 

i= 1 


U 0 Mi 

2 


x cos [(co 0 - £2,-) t + (p 0 - <!>,] 


(4.13) 


The spectral diagram of the modulating signal s(t), plotted in 
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Fig. 4.2 Spectral diagrams: (a) modulating signal; (b) AM signal in the case 
of multitone modulation 

accordance with Eq. (4.9), appears in Fig. 4.2a; the spectral 
diagram of the multitone AM signal corresponding to that 
baseband signal is shown in Fig. 4.2 b. As is seen, in addition to the 
■ carrier, the spectrum of the multitone AM signal contains a band of 

The spectrum of the upper side frequencies (the upper sideband) and a band of lower side 

AM signal frequencies (the lower sideband). The spectrum of the upper 

sideband is a scaled replica of the spectrum of the modulating 
signal, translated into the high-frequency range by a> 0 . The lower 
sideband, too, has the spectral diagram of the signal s{t), but it is 
a mirror image of the upper sideband, both sidebands being 
symmetrically located about the carrier co 0 . 

From the foregoing, the following important conclusion may be 
drawn: The bandwidth occupied by an AM signal is twice the highest 
significant frequency in the spectrum of the modulating baseband 
signal 


Example 4.1. Determine the number of radio broadcast channels 
that can be accommodated in the frequency range from 0.5 to 
1.5 MHz (this is approximately the limits of the medium-wave band). 

For radio broadcasts to be reproduced with satisfactory fidelity, 
it is necessary to reproduce audio frequencies from 100 Hz to 12 
kHz. Hence, the bandwidth allotted to each AM channel is 24 kHz. 
To avoid cross-channel interference, a guard space of, say, 1 kHz, 
must be provided between adjacent channels. Therefore, the 
permissible number of channels is 

N = (1.5 - 0.5) x 10 6 /(25 x 10 3 ) = 40 


1 kHz 


M 1 i / 

24 kHz 


On-off keying. An important class of multitone AM signals are 
those produced by keying. In the simplest case, they are a train of 
* „ _ , . radio pulses separated by intervals within which there is no carrier 

On-off keyed signals present Such signals are typical of radio telegraphy and other 
systems transmitting discrete information over radio channels. 

On-off keyed signals are widely used in pulse radar. For-better 
resolution, use is made of short pulses with a duration of a few 
fractions of a microsecond. 
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If s(t) is a function which takes on value 0 or value 1 at each 
instant of time, then an on-off-keyed signal can be described as 

Mkeyed(0= U 0 s(t)COS {(D 0 t + (p 0 ) (4.14) 

As an example, let the function s(t) represent a periodic train of 
video pulses such as examined in Example 2.1 (see Chap. 2). 
Assume that their amplitude is A — 1, then on the basis of Eq. 
(4.14) we have 

00 

., u 0 U 0 sin (nn/q) 

Mkeyed (t) — -COS (tt) 0 t + <p 0 ) H-/ - - - 

q q /_J nn/q 

n = 1 

00 

r/ \ ^0 V 1 sin (nn/q) 

x cos [(oo 0 + t + (p 0 ] -I-) --- 

q nn/q 

n= 1 

x cos [(co 0 — t + cp 0 ] (4.15) 

From inspection of the above expression, we may conclude that 
a keyed signal has all the features of a multitone AM signal. The 
difference, at least theoretical, lies in the fact that its spectrum 
extends without bound. 

Phasor representation of an AM signal. In some cases, it may 
prove useful to represent an AM signal graphically as the sum of 
phasors rotating in a complex plane. 

For simplicity, we shall limit ourselves to the case of single-tone 
amplitude modulation. The instantaneous value of the carrier 

Wear (t)=U o COS (ffl 0 t + Cp 0 ) 

is a projection of a phasor, U car = U 0 exp(/'cp 0 ), stationary in time, 
onto the angle axis which rotates about the origin of coordinates at 
an angular velocity co 0 in the clockwise direction (Fig. 4.3). 

The upper side wave is shown in the diagram as a phasor of 
length U 0 M/ 2, whereas its phase angle at t = 0 is equal to the sum 
of the initial phases of the carrier and the modulating signal (see 
Eq. (4.5)). The lower side wave is represented by a similar phasor 
which only differs by the sign it takes in the expression for its phase 
angle. Thus, we should construct on the complex plane the sum of 
the following three phasors: 

F r car= U 0 exp O'(p 0 ) 

f/us = (MI/ 0 /2)exp[j(cpo + ^o)] 

U\ s = (M£/ 0 /2)exp [ 7(90 — ^ 0 )] 

It is easy to see that the sum will be oriented along the phasor 
(7car- The instantaneous value of the AM signal at t = 0 is equal to 



Waveform of an on-off 
keyed signal 
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r >0 


Work Problems 2 
and 4 


qj 

u>n-Q wo w 0 +Q 

The spectrum of a 
single-tone DSB-SC 
modulated signal 


# 

Beats 


the projection of the tip of the resultant phasor on the horizontal 
axis. 

As time goes on, in addition to the rotation of the angle axis we 
have already spoken about (Fig. 43b), two more events will occur: 
(1) the phasor U us will rotate about the point of application at an 
angular velocity Q in the counter-clockwise direction, because the 
total phase angle of the upper side wave (co 0 + D) t + cp 0 + O 0 must 
increase faster than the phase of the carrier; and (2) the phasor U\ s 
will rotate likewise at an angular velocity Q, but in the opposite 
direction. 

By constructing the phasor Ux and projecting it onto the angle 
axis, we can determine the instantaneous values wam(£) at any 
instant of time. 

The phasor diagram of a multitone AM signal is identical in 
meaning, but the graphical construction may be unwieldy. 

Double-sideband-suppressed-carrier (DSB-SC) modulation. We 
have seen that a good proportion of the power in conventional AM 
signal is concentrated in the carrier. The transmitter power can be 
better utilized by using AM signals with a suppressed carrier. This 
is known as double-sideband-suppressed-carrier (DSB-SC) 
modulation. On the basis of Eq. (4.4), a single-tone DSB-SC signal 
may be represented as follows: 

u sc (t) = C 0 Mcos(Qt + <J> 0 )cos(cd 0 £ + (p 0 ) 

= (U 0 M/ 2) cos [(co 0 + Q)t + cp 0 + O 0 ] 

+ (U 0 M/ 2)cos [(©o - Q) t + cp 0 “ <&o] ( 4 - 16 ) 

What happens is in effect the multiplication of two signals, the 
modulating signal and the carrier. From a physical point of view, 
oscillations such as defined by Eq. (4.16) are produced by beating 
together (heterodyning) two harmonic signals. The beats have the 
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same amplitude U 0 M/2 and their frequencies are respectively equal 
to the upper and lower side frequencies. 

In the case of multitone DSB-SC modulation, the analytical 
expression for the resultant signal takes the form 

N 

u sc (t) = U 0 Mi cos [(coo + Qj)t + cpo + ] 

N 

+ U Q X Mi cos [(co 0 - DO t + (Po - 3h)] ( 44 7 ) 

i = 1 


As with conventional amplitude modulation, there appear two 
sidebands, one upper and the other lower, located symmetrically 
about co 0 . 

From an oscillogram of beats, it would appear unclear why there 
is no carrier in the spectrum of the signal, despite the generation of 
the carrier frequency component. The explanation is this. As the 
beat envelope crosses zero, the phase of the r.f. component is 
abruptly reversed, because the function (cos Qt + O 0 ) takes opposite 
signs on the right and left of zero. If such a signal is applied to 
a high-Q oscillatory system (say, an LC resonant circuit) tuned to 
frequency co 0 , the output effect will be very small, tending to zero as 
the g-factor increases without bound. The oscillations excited in the 
system by one beat cycle will be cancelled by the next. That is how 
the spectral expansion of the signal is customarily interpreted from 
a physical viewpont. We will go back to this matter in 
Chap. 9. 

For all of its obvious advantages, DSB-SC modulation has not 
found any appreciable use in radio broadcasting and radio 
communication. The principal drawback is that in demodulating 
a DSB-SC signal the carrier must be generated locally at the 
receiving end and combined with the sidebands. This substantially 
increases the complexity of the receiver. 

Single-sideband (SSB) modulation. An interesting improvement 
over the conventional amplitude modulation is the transmission of 
a signal in which the upper or lower sideband is suppressed. The 
primary advantage of SSB signals is that they require only half the 
bandwidth of DSB service. This is of special importance for the fre¬ 
quency-division multiplexing (FDM) of communication channels, 
such as in operation on short waves where the allotted frequency 
band is crowded to the limit. 

In outward appearance, SSB signals resemble conventional AM 
signals. For example, a single-tone SSB signal with the lower 
sideband suppressed may be written as 



IlllllT, - 

U)q 

The spectrum of an 
SSB signal 


w ssb(0 = Co cos (co 0 t + cpo) + (C 0 M/ 2)cos [(co 0 + D)£ + cp 0 + ^>o] 
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The phasor diagram of 
two signals in quadra¬ 
ture 



(D 0 


The spectrum of an 
SSB-SC signal 


On carrying out obvious trigonometric manipulations, we obtain 
u ssb(0 = U 0 cos{(o 0 t + cpo) + (C/oM/2)cos(Qt + O 0 )cos(co 0 f + cp 0 ) 

- (U 0 M/ 2) sin (Qt + O 0 ) sin (co 0 t + (p 0 ) 

= U 0 [1 + (M/2)cos (Qt + O 0 )] cos (co 0 t + cp 0 ) 

- (C7 0 M/2)sin (Or + O 0 )sin (co 0 t + cp 0 ) 

The last terms are the products of two functions one of which 
varies more slowly. Noting that the “faster” terms are in time 
quadrature with one another, the slowly varying envelope of the 
SSB signal is found to be 

U(t) = t/ol/D + (M/2) cos (Qt + <t> 0 )] 2 + (M 2 /4)sin 2 (Qf + <t 0 ) 

= U 0 |/l + Mcos (Qt + €> 0 ) + M 2 /4 (4.18) 

A plot of the envelope of an SSB signal, as found by Eq. (4.18) 
for M = 1, appears in Fig. 4.4 which also shows for comparison the 
envelope of a conventional single-tone AM signal for the same 
modulation depth. 



Fig. 4.4 The envelope of a single-tone signal: ( 1 ) single-tone SSB signal; (2) 
conventional AM signal for M = 1 

From comparison of the two curves it is seen that the direct 
demodulation of an SSB signal from its envelope would introduce 
appreciable distortion. 

A further improvement in the SSB transmission can be achieved 
by suppressing the carrier partly or completely. In this way, the 
transmitter power is utilized still better. 

4.2 Angle Modulation 

Let us consider the case in which the modulating signal s(t) 
leaves the amplitude U 0 of the harmonic carrier 

Wear (0 = Uq COS (cg t + (p) 
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unchanged. Instead, the entire argument of the carrier, that is the 
angle 

\|/ (t) = cot + cp 

called the total phase, varies in sympathy with the modulating 
signal. Quite aptly, the process is called angle modulation. 

Principles of angle modulation. Basically, the angle \|/(t) can be 
varied in one of two ways. In the first of these, the total phase is 
related to the modulating signal s(t) by an equation of the form 

\|/(f) = co 0 t + ks(t) (4.19) 

where k is a proportionality factor, and co 0 is the unmodulated 
carrier frequency (existing in the absence of the modulating signal). 
As follows from Eq. (4.19), the angle \|/(f) varies as the initial phase 
follows the modulating angle. In this system, the initial phase is 
proportional to the modulating signal, and the name phase 
modulation (PM) is applied: 


WpmM — U 0 cos [coo? + ks(ty\ (4.20) 


So long as 5 ( t ) = 0, the PM waveform is a simple harmonic wave. 
As s(t) builds up in magnitude, the angle v| f(t) increases with time 
faster than linearly. When the modulating signal decreases, the time 
rate of change of \| /(t) decreases, too. An example of a PM signal is 
shown in Fig. 4.5. 



Fig. 4.5 Phase modulation: (I) baseband modulating signal; (2) unmo¬ 
dulated harmonic wave; (3) phase-modulated signal 

At the instants of time when s(t) is at its peak value (positive or 
negative), the absolute value of the phase shift between the PM 
waveform and the unmodulated carrier is a maximum. This limiting 
value of the phase shift is called the phase deviation, Av|/. In the 


The total phase 


Phase modulation 
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Phase deviation 


Instantaneous frequen¬ 
cy 


general case, when the signal s(t) changes sign, it is customary to 
differentiate between the upward phase deviation 

A\|/ U p = kSmax 

and the downward phase deviation 

AvJ/down = ks m [ n 

If we draw a PM signal on a phasor diagram, we will see that the 
representative constant-length phasor rotates at a varying angular 
velocity. The instantaneous frequency co (t) of an angle-modulated 
signal is defined as the first time derivative of the total phase angle 

co(0 = dv|//dt (4.21) 

such that 

t 

\|/ (t) = j co (x) dx + const (4.22) 

— 00 

In the second case, the instantaneous frequency co (t) of the 
modulated wave is made proportional to the modulating signal 
such that 



The waveform of a 
typical angle-modula¬ 
ted signal 


co ( t ) = co 0 + ks ( t ) (4.23) 

This is known as frequency modulation (FM). Here, 

t 

U FM (t) = Uo COS [coot + k J s (t) dx] (4.24) 

— 00 

In the general case, the natural parameters of an FM signal are, 
in accordance with Eq. (4.23), the upward frequency modulation 

Aco U p = kSmax 

and the downward frequency modulation 
AcOdown = kSmin 

If s(t) is a sufficiently smooth time function, there will be no 
outward difference between PM and FM waveforms. But there is 
a fundamental difference between them: the phase shift of a PM 
signal with respect to the unmodulated (reference) wave is 
proportional to s(t), whereas for an FM signal this shift is 
proportional to the integral of the signal being transmitted. 

Single-tone angle-modulated signals. Mathematically, it is far 
more complex to analyse PM and FM signals than AM signals. 
For this reason, emphasis will be placed on single-tone signals, that 
is, signals modulated by a single baseband frequency. 

For a single-tone FM signal, the instantaneous frequency is given 
by 

co ( t ) = co 0 + Aco cos (Qt + O 0 ) 
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where Aco is the frequency deviation. On the basis of Eq. (4.22) the 
total phase of this signal is 

v|/ (t) = co 0 t + (Aco/Q) sin (£lt + O 0 ) + cp 0 

Hence, the quantity 

m = Aco/Q (4.25) 

called the angle modulation index of a single-tone FM signal, 
represents the deviation of the signal phase, expressed in radians. 

To simplify the notation, let us set the time-invariant phase angle 
cp 0 and O 0 equal to zero and write the instantaneous value of the 
FM signal as 

u ( t ) = U 0 cos (co 0 t + m sin Qt) (4.26) 

The analytical expression for a single-tone PM signal will be the 
same, but the following point must be borne in mind: PM and FM 
signals behave differently as the modulating frequency and the 
amplitude of the modulating signal are varied. 

In frequency modulation, the frequency deviation Aco is 
proportional to the amplitude of the modulating (baseband) signal, 
but is independent of the modulating frequency. In phase 
modulation, the modulation index m is proportional to the 
amplitude of the modulating signal, irrespective of its frequency. As 
a consequence, the frequency deviation in FM linearly rises with 
increasing frequency Q, in accord with Eq. (4.25). 

Example 4.2. A VHF radio station operating at a carrier frequency 
of f 0 = 80 MHz transmits a PM signal modulated by a baseband 
signal at a frequency F = 15 kHz. The modulation index is m = 12. 
Find the limits between which the instantaneous frequency of the 
signal varies. 

The mathematical model of the signal has the form 
u(t)= I/ 0 cos[2tc x 8 x 10 7 t+ 12sin27i x 1.5 x 10 4 t] 

The frequency deviation is 
Af= mF= 1.8 x 10 5 = 180 kHz 

Thus, under modulation, the instantaneous frequency of the signal 
varies from 

/ min = 80 - 0.18 = 79.82 MHz 
to 

/ max = 80 + 0.18 = 80.18 MHz 

Spectral expansion of FM and PM signals at low values of the 
modulation index. It is relatively simple to represent angle-mo¬ 
dulated signals as a sum of harmonic waves, if we limit ourselves to 
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The angle modulation 
index 
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the case of m« 1. For this purpose, let us re-arrange Eq. (4.26) in 
the following way: 

u (t) = U 0 cos ((Q 0 t-hm sin Qt) 


= U 0 cos(msinQt)cosco 0 t — U 0 sin (m sin Qt) sin co 0 t (4.27) 


The waveforms for 
which m« 1 are called 
narrowband FM or 
PM signals 


Since we assumed a small angle modulation index, we may use 
the following approximate equalities 

cos (m sinQt)#l 


sin (m sin Qt) # m sin Qt 

On this basis, we obtain from Eq. (4.27) 

u (t)x U 0 cos co 0 t + (mUJ2)cos (co 0 + O) t - (mUJ2) cos (co 0 - O) t 

(4.28) 

Thus, at m«l, the spectrum of the angle-modulated signal 
contains the carrier wave and two side components, upper and 
lower, at frequencies co 0 + Q and oo 0 — O. The modulation index 
m plays here the same role as the modulation depth M in 
amplitude modulation (cf. Eq. (4.5)). However, we can see 
a substantial difference between the spectra of an AM signal and an 
angle-modulated signal. The spectral diagram (see Fig. 4 .6a) plotted 
on the basis of Eq. (4.28) is characterized by the fact that the lower 
side wave has an additional phase shift of 180°. 



Fig. 4.6 Diagrams of an angle-modulated signal for m« 1; (a) spectral 
diagram; ( b ) phasor diagram 


As a consequence, the sum of the phasors representing the two 
side waves (see Fig. 4.6 b) is always at right angles to the carrier 
phasor U c ar . With time, the phasor swings about a central 
position. The small variations in the length of the phasor are 
related to the approximate nature of our analysis; at very low 
values of m they may be justifiably neglected. 

A more rigorous spectral analysis of angle-modulated signals. We 
may try to refine the result obtained above, by using two terms 
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from the series expansion of harmonic functions of a small 
argument. Then Eq. (4.27) takes the following form 

u(t)~ U 0 cosco 0 t(l — m 2 sin 2 Qt/2) 

- U 0 sin co 0 t (m sin Qt — m 3 sin 3 Qt/6) 

Simple trigonometric manipulations yield the following result: 
u (f) = U 0 (1 - m 2 / 4) cos co 0 t + U 0 m (1 - m 2 /8) [cos (co 0 + Q) t 

- cos (co 0 - n) t] + U 0 (m 2 /8) [cos (<d 0 + 2Q) t 
+ cos (co 0 ~ 2Q) t\ + (U 0 m 3 / 48) [cos (co 0 + 3Q) t 

- cos (co 0 — 3Q) t] (4.29) 

Equation (4.29) reflects a remarkable fact: it states that in 
addition to the already known components the spectrum of 
a single-tone angle modulated signal contains the upper and lower 
side waves at the harmonic frequencies of the modulating wave. 
Therefore, the spectrum of such a signal is more complex in struc¬ 
ture than that of the respective AM signal. Also, the new spectral 
components lead to a redistribution of energy over the spectrum. 
As is seen from Eq. (4.29), an increase in m is accompanied by a rise 
in the amplitude of the side components, whereas the amplitude of 
the carrier wave decreases by a factor of (1 — m 2 /4). 

The spectrum of an angle-modulated signal at an arbitrary 
modulation index. For the simplest case of single-tone angle 
modulation we can derive a general expression applicable to any 
value of the modulation index m. 

The division of mathematics dealing with special functions proves 
an important formula related to the Fourier series expansion-the 
exponential function with a special form of imaginary exponent: 

exp ( — ja sin x) = cos (a sin x) — j sin (a sin x) 

00 

= J 0 (a) + 2 £ J 2 k(a) cos2kx 

fc= 1 

00 

- fl X i 2 fe - i («) sin (2fc - 1) x (4.30) 

k =1 

where Jk(a) is the Bessel function of a, of order k. From 
a comparison of (4.30) and (4.27), we may re-write the last equation 
thus: 

00 

u(t)=U 0 cos(Q 0 t[J 0 (m) + 2 X J 2 k(w) cos 2kQ.t] 

k= 1 

00 

- U 0 sin ©of [2 X *^2* -1 ( m ) sin ( 2fe - !)^] 

k= 1 


A 

Solve Problem 11 
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(4.31) 
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Since 

cos co 0 t cos 2kQt = y cos (co 0 - 2kQ) t + ~ cos (co 0 + 2kQ.) t 
and 

sin o) 0 tsin (2k— l)Qf = yCOS [co 0 — (2 k— 1)0] t 
- y cos [co 0 + (2k - 1)0] t 

we may re-write Eq. (4.31) in a more compact form 

00 

u{t)=U 0 £ Jk (m) cos (oo 0 + kd) t (4.32) 

k= — oo 


To sum up, the spectrum of a single-tone angle-modulated signal 
■ contains, in the general case, an infinite number of components 

The spectrum of a whose frequencies are oo 0 ± kQ; and their amplitudes are 
single-tone angle-mo- proportional to the values of Jk(m). 

dulated signal In the theory of Bessel functions it is proved that functions with 

positive and negative indices are interrelated: 

J= 1 f Jk(m) 

Therefore, the initial phases of the sidebands co 0 + kQ and co 0 - kQ 
are the same if k is even, and differ by 180° if k is odd. 



Fig. 4.7 Plots of Bessel functions J 2 (m) and J l6 (m) 
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For a detailed analysis and the construction of spectral diagrams, 
it is important to know the behaviour of functions Jk(m) according 
to the value of k for various values of m. Plots of two Bessel 
functions substantially differing in the value of k are given in 
Fig. 4.7. 

The following trend is apparent: The greater the order of a Bessel 
function, the greater the range of values of the argument for which 
the function is very small. More accurately this fact is depicted in 
Table 4-1. 


In the shaded area the 
Bessel functions be¬ 
come negligibly small 


Using Table 4-1 together with Eq. (4.32), we can readily construct 
typical spectral diagrams for single-tone angle-modulated signals at 
not very large values of the modulation index m (Fig. 4.8). 




Fig. 4.8 Spectral diagrams of angle-modulated signals for two values of m. 
(The amplitudes are plotted on a relative scale.) 


Table 4-1 Values of Bessel functions J k (ni) 
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The practical band¬ 
width of FM and PM 
signals 


Interestingly, the increase in the modulation index is 
accompanied by a broadening in the bandwidth occupied by the 
signal. Ordinarily, it is assumed legitimate to neglect all spectral 
components for which k>m+ 1. Hence, the practical bandwidth 
for an angle-modulated signal may be estimated as 

BWpract = 2(m + 1)Q (4.33) 

As a rule, for real FM and PM signals m» 1. Therefore, 


BWpract ~ 2 mQ = 2Aco (4.34) 


▲ 

Work Problem 12 


Angle-modulated sig¬ 
nals are often used 
for high-fidelity broad¬ 
casts in the VHF 
and UHF bands 


Or, in words, an angle-modulated signal occupies a bandwidth 
approximately equal to twice the frequency deviation. 

As will be recalled, the transmission of AM signals requires 
a bandwidth equal to 2D, or by a factor of m smaller. The 
broadband nature of FM and PM signals limits their applicability 
to the metric and shorter wavelengths (VHF and UHF bands). On 
the other hand, this very property-the broadband nature-makes 
angle-modulated signals more immune to interference and noise as 
compared with AM signals. 

It has already been noted that the increase in the angle 
modulation index entails a re-distribution of power within the 
signal spectrum. Notably, if the value of m is chosen such that 

J o (m) = 0 (435) 

the carrier frequency (o 0 will be absent in the spectrum. The values 
of m, which are the roots of Eq. (4.35), form an infinitely increasing 
sequence of numbers m v (v = 1, 2, ... is the No. of the root). Several 
roots of the equation are given in Table 4-2. 


Table 4-2 Roots of the equation J Q {m) = 0 


V 

1 

2 

3 

4 

5 

6 

7 

m v 

2.405 

5.520 

8.654 

11.792 

14.931 

18.071 

21.212 


Example 4.3. A single-tone FM signal has a frequency deviation 
A/= 240 kHz. Find the modulating frequencies F at which the carrier 
will be absent in the spectrum of the modulated signal. 

The modulation index is 

m = Aco/D = A f/F 

Hence, the modulating frequency is 
F = A f/m 

Referring to Table 4-2, we find the sequence of frequencies that 
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meet the stated condition: 

F x = 240 4- 2.405 = 99.792 kHz 

F 2 = 240 -f 5.520 = 43.478 kHz 

F 3 = 240 3- 8.654 = 27.732 kHz 


Angle modulation in the case of a nonharmonic modulating 
wave. An interesting behaviour of angle-modulated waves is 
brought out if we analyse the case where the modulating wave is 
not harmonic. For simplicity, let us consider a signal modulated by 
two baseband frequencies: 

u{t)= U 0 cos (co 0 £ + m 1 sin Qf + m 2 sin D 2 £) 

= U 0 cos(o 0 tcos(m 1 sinQ. 1 t + m 2 sinQ. 2 t) 

— U 0 sm(n 0 tsin(m 1 sm£l 1 t + m 2 sinQ. 2 t) (4.36) 

Assume that the partial modulation indices m 1 and m 2 are so 
small that we may use approximate expressions for the cosine and 
the sine: 

cos x ^ 1 — x 2 /2, sin x ^ x 

By carrying out somewhat tedious, but elementary trigonometric 
manipulations, we may write the original signal as a sum: 

u(t)= U 0 { 1--—-)cosco 0 £ + -—[cos (co 0 + D x ) £ 

— cos (co 0 — QJ t] H-[ cos (^o + ^ 2 ) ^ 

r 

— cos (co 0 — Q 2 ) £] H--— [cos (co 0 + 2Q X ) £ 

8 

m 2 U 

+ cos (co 0 - 2Qj) f] H-[cos (co 0 + 2Q 2 ) t + cos (co 0 - 2D 2 ) t] 

8 

YYX TYl 

H- U 0 [cos (co 0 + Q 1 — D 2 ) £ + cos (co 0 - D x + D 2 ) £ 

— cos (co 0 + Di + D 2 ) £ — cos (cg 0 — D x — D 2 ) £] (4.37) 

In sketch form, the spectral diagram of a two-tone angle-mo¬ 
dulated signal is shown in Fig. 4.9. 

A fact of fundamental importance should be stressed: In addition 
to the frequencies co 0 ± co 0 — ^ 2 ? ± 2D X and ol ) 0 ± 2D 2 , the 
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▲ 

Work Problem 18 


Do not confuse “nonli¬ 
near modulation” and 
“nonlinear network” 




Fig. 4.9 Spectral diagram of a double-tone angle-modulated signal for low 
values of the partial modulation indices m x and m 2 


spectrum of the above signal contains intermodulation products 
co 0 ± ^1 ± 0 2 , taking all the four signs. Their amplitudes depend on 
the product of the two partial modulation indices. 

If we abandon the assumption of a small modulation index and 
assume that the modulation is effected by a group of baseband fre¬ 
quencies Qi, 0 2 , 0 N , then the spectrum of a phase- or fre¬ 
quency-modulated signal will contain all likely frequencies co 0 + 
±n 1 0 1 ± ... ±n N 0 N , where n u ...» n N are all likely integers, 
including zero. Thus, with all other conditions being equal, the 
spectrum of PM and FM signals is far richer in components than 
the spectrum of AM signals. 

In order to stress the interaction between the various components 
of the modulating signal, angle modulation is sometimes called 
nonlinear in contrast to amplitude modulation. 


4.3 Pulsed FM Signals 

Now let us examine the spectral and correlation properties of 
a special class of modulated signals which have recently come to be 
widely used in radar. They differ from simple r.f. pulses in that 
their carrier varies (is modulated) in frequency. Most frequently, use 
is made of a type of pulse frequency modulation in which the 
instantaneous frequency varies linearly with time. 

The principle of linear frequency modulation (LFM). Consider an 
r.f. pulse having a rectangular envelope, and assume that the r.f. 
carrier of the pulse has a frequency linearly rising with time. To 
make the mathematical model of this signal more specific, let its 
duration be x p , such that the point t = 0 occurs in the middle of the 
pulse, and the instantaneous frequency varies with time as 

co(0 = co 0 + \xt (4.38) 

where © 0 is the carrier frequency and p is a parameter of dimension 
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s~ 2 , which defines the time rate of change of the frequency. 

It is easy to see that over the time interval equal to the pulse 
duration the frequency deviation will be 

Aco = pip (4.39) 

The total phase of the signal is 

v|/ (f) = (o 0 t + \it 2 / 2 (4.40) 


To this we should have added the constant phase shift cp 0 , but its 
presence is immaterial. 

Thus, let us use the term linear-FM radio pulse (or shortly, LFM 
pulse ) to call a signal representable by the following mathematical 
model: 


l t< — ip/2 

u (t) = J L/qCos (o) 0 f + \it 2 /2), - tp/2 < t < Tp/2 
j 0, t > ip/2 


(4.41) 


The remarkable property of LFM signals that makes them of 
practical value consists in the following. Suppose that we have at 
our disposal a physical device which delays the signals applied to 
its input. If the delay time td is arranged to decrease with increasing 
signal frequency, then, given certain conditions, the long-duration 
LFM signals applied to the device will be “compressed” in time. 
More specifically, the output signal from the delay device, or the 
compressor, will contain both the low-frequency components 
associated with the start of the applied pulse, and the higher-fre¬ 
quency components associated with its finish at practically the same 
time owing to the time delay. 

It is easy to realize that if the power loss within the compressor 
is small, the amplitude of the output signal will be boosted 
appreciably and can markedly exceed the noise level. This enhances 
the reliability of radar signal detection in noise. 

The mechanism of LFM signal compression we have just 
described gives only an idea about the principle by which such 
systems operate. A more detailed analysis from which the effect can 
be judged quantitatively will be given in Chap. 16 in connection 
with the optimal detection of signals in noise. 

The spectrum of a rectangular LFM pulse. In the previous 
section concerned with the spectral characteristics of an FM signal 
modulated by two baseband frequencies, we have seen that its 
spectrum has a complex structure due to intermodulation, or the 
cross-interaction of the individual components. All this fully applies 
to the spectrum of an LFM pulse. In the discussion that follows we 
shall mainly adhere to the notation used in [21]. 

On the basis of (4.41), the amplitude spectral density, or spectrum 


Such devices are called 
dispersive delay lines 


Input signal 

r wvwww ' 


Compressor 



Noise 
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of a single LFM pulse may be written as 

V 2 

U (co) = U 0 J cos (co 0 t + pt 2 /2) exp ( - jcot) d t 

- V 2 


V 2 

= (Uo/2) I exp {/[(co 0 - co)t + pt 2 /2]} d t 
-V2 


Tp/2 

+ (U 0 /2) J exp { - j [(co 0 + co) t + pt 2 /2]} d t (4.42) 

-V 2 

In analysing the above relation, we note that the first integral 
describes that part of the spectrum which has a sharp maximum in 
the region of positive frequencies close to g> 0 . Accordingly, the 
second integral corresponds to that part of the spectrum which is 
mainly concentrated at co < 0. In practice, we are solely interested 
in the case where the overlapping of the spectra concentrated at 
positive and negative frequencies is negligibly small. This is because 
the total frequency deviation over the pulse duration is a very small 
fraction of the carrier frequency: 


Aco = |iTp«a>o 


As will be recalled, 

U(- co) = U* (co) 


Therefore, in Eq. (4.42) only the first integral needs to be 
evaluated as it defines the spectrum at co > 0. Then the negative-fre¬ 
quency spectrum may be derived on the basis of the known 
properties of the Fourier transform for real signals (see Chap. 2). 

In view of the foregoing and completing the argument of the 
exponential function in (4.42) to the square, we obtain 


U (co) = (U 0 / 2) exp 


. (co - oo 0 ) 2 

J 2p 


V 2 

S ex P 

-tp/2 


j(p/2)(f 


<Q ~ too ^ 2 


d t 


(4.43) 


It is convenient to change from the variable t to a new argument, 
x, in accordance with the formula 


Vv(t 


co — co ( 


F 




On calculating, we find 


U (a) = (U 0 /2) |/n/p exp 


-J- 


. (to - w 0 ) 2 


2p 


f exp(/7Dc 2 /2)dx (4.44) 

-*i 
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where the integration limits are 

v MV2 + (co - co 0 ) 

,= 

and 


X 2 = 


pip/2 - (co - co 0 ) 

Vw 


(4.45) 


The integral in Eq. (4.44) reduces to a combination of well 
explored special functions called the Fresnel integrals : 


C(x)= jcos(7t^ 2 /2)d^ 
0 

X 

S(x) = Jsm(7t£ 2 /2)d£ 


Fresnel integrals are 
widely used in physics 
to solve problems of 
wave diffraction 


For x»l, 

1 sin (nx 2 /2) 

C(x)^xr +- 

2 nx 


S(x)' 


1 cos (nx 2 /2) 


2 nx 

As a result, we obtain the final formula for the spectrum of the 
LFM signal in question: 


C/(co) = ([/ 0 /2)l/^ 


exp 


. (co - co 0 ) 2 


-J- 


2p 


X {CiX,) + C(X 2 ) +j [Six,) + S(X 2 )]} 


(4.46) 


If we write the spectrum in exponential form 
u (®) = I U (co) I exp [j<t> (co)] 
it will be noted that its magnitude 


I u (co) I = (Uo/2) K'ti/p 1/[Cprj + C(X 2 )] 2 + [S(X x ) + S(X 2 )] 2 (4.47) 


whereas the phase spectrum consists of a quadratic term 
<!>! (co) = - (co - co 0 ) 2 /2p 


and the so-called residual phase term 
S(X x ) + S(X 2 ) 


0 2 (co) = arctan 


C(X x ) + C(X 2 ) 


(4.48) 


(4.49) 
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• 

The frequency de¬ 
viation-pulse duration 
product 


LFM signals with a large frequency deviation-pulse duration 
product. Numerical analysis of the above equations indicates that 
the manner in which the magnitude and phase of the spectrum of 
a rectangular LFM pulse depend on frequency is fully decided by 
a dimensionless number 


B = Acoip = pip (4.50) 


called the frequency deviation-pulse duration product of an LFM 
signal. 

In cases of practical interest, B» 1. The spectrum of such LFM 
signals has a number of specific properties. Firstly, the magnitude 
of the spectrum is practically constant over the bandwidth Aco with 
centre at co 0 . The corresponding plots based on Eqs. (4.47) and 
(4.49) appear in Fig. 4.10. 



Fig. 4.10 Frequency dependences of the magnitude and the residual phase 
term of the spectrum of a rectangular LFM signal for several values of the 
frequency deviation-pulse duration product 

Secondly, the oscillations of the magnitude gradually decay with 
increasing frequency deviation-pulse duration product. From an 
analysis of (4.47), it can be verified that at the centre frequency of 
the spectrum 


▲ 

Work Problem 14 


\U(co 0 )\ = U 0 ]/^ 


(4.51) 
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Thus, an LFM signal with a large frequency deviation-pulse 
duration product can approximately be represented by the magni¬ 
tude of the spectrum 

f 0, 0 < co < co 0 ~ Aco/2 

| U (co)| = U 0 ]/n/2[i, G) 0 ~ Acd/ 2 < co < co 0 + Aco/2 (4.52) 

( 0, co > co 0 + Aco/2 

The power spectral density of such a signal 
Wu = nU 2 0 /2\x (4.53) 

is likewise constant within the frequency interval (co 0 - Aco/2, co 0 + 

+ Aco/2), and vanishes elsewhere. 

Example 4.4. A rectangular LFM pulse has an amplitude U 0 = 
= 20 V, a carrier frequency f 0 = 10 GHz, and a duration t p = 2 ps. 
The frequency deviation over the pulse duration is A f = 0.1 GHz. Find 
the basic parameters of the signal spectrum. 

To begin with, we find the frequency deviation-pulse duration 
product of the signal: 

£ = 6.28 x 10 8 x 2 x 10" 6 = 12.56 x 10 3 

The rate of frequency rise is 

n = 2rcA//Tp = 6.28 x 10 8 ^(2x 10 _6 )= 3.14 x 10 14 s" 2 
By Eq. (4.53), the power spectral density is 
W u = 0.5 x 10" 12 

Since the signal has a large frequency deviation-pulse duration 
product, its spectrum is practically enclosed within the bandwidth 
from 

/ 0 -A//2 = 9.95 GHz 
to 

f 0 + A//2 = 10.05 GHz 


The autocorrelation function of an LFM signal. In order to find 
this characteristic so important in signal detection, it is advisable to 
use the results obtained in Chap. 3 where it is shown that the 
autocorrelation function and the power spectrum of a signal are 
uniquely related by a Fourier transform pair. 

Let us assume that the frequency deviation-pulse duration 
product, B, of an LFM signal is so large that the power spectrum 
of the signal is uniform and concentrated around the carrier fre¬ 
quency within a frequency band Aco wide. Then the autocorrelation 
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function of the LFM signal [see Eq. (4.53)] may be defined as 

| 00 

■Klfm(t) = — 1 W u (©) exp (/cox) dco 

ZU —co 


®o + F P /2 

= (U 2 J2\i) j cos cox dco 
®0-^ P /2 


C/gip sin (px p t/2 


cos C0 0 T 


(4.54) 


2 pXpi/2 

A plot of the normalized autocorrelation function 
r LFM ( T ) = ^LFM (co)/^LFM (0) 

appears in Fig. 4.11 which also shows the lobed envelope of the 
function. 



Fig. 4.11 Correlation properties of an LFM-pulse: (a) normalized 
autocorrelation function; ( b ) its envelope 


Equation (4.54) defines an important property of LFM signals: 
The width of the main lobe in the envelope of the autocorrelation 
function is inversely proportional to the frequency deviation over 
the pulse duration. This is so because the envelope first reduces to 
zero when the time shift between the signal and its replica is equal 
to x = 27 r/|ix p = 1/A/ Radar signals have a substantial frequency 
deviation, so the main lobe of the autocorrelation function is very 
narrow. For instance, taking the signal defined in Example 4.4, the 
time shift at which the envelope of the autocorrelation function 
reduces to zero is a mere 0.01 ps, which is 0.5% of the pulse 
duration. 

From the view-point of correlation properties, however, LFM 
signals suffer from a limitation: the height of the first two 
symmetrical side lobes of the autocorrelation function is fairly large, 
being 0.212 of that of the main lobe. Given unfavourable conditions 
(a substantial noise level), this may result in an error in determining 
the time position of the pulse. 
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Summary 

<£0 Modulation is a process whereby the signal spectrum is translated from the baseband 
into a radio-frequency range. 

In amplitude modulation, the signal envelope is proportional to the instantaneous 
magnitude of the baseband modulating wave. 

< v*C> The spectrum of an AM signal is formed by the carrier wave and two symmetrical 
sidebands. 

The bandwidth required for AM transmission is equal to twice the highest significant 
frequency in the spectrum of the modulating wave. 

00 It is possible to modulate the carrier so as to produce a double-sideband (DSB) 
suppressed-carrier signal and also a single-sideband (SSB) signal. 

In angle modulation, the phase angle of the carrier varies in time in accordance with 
the message signal. 

The particular forms of angle modulation are frequency modulation and phase 
modulation. 

The principal parameter of the modulated signal in PM and FM is the angle 
modulation index equal to the phase deviation. 

< v s v > Theoretically, there is no bound on the bandwidth of an angle-modulated signal. 
At small values of the modulation index, the bandwidth of the signal is practically 
equal to twice the maximum frequency of the modulating wave. 

At large values of the modulation index, the bandwidth occupied by the signal is 
equal to twice the frequency deviation. 

00 In linear frequency modulation, signals have a practically uniform spectrum within 
a limited bandwidth, provided the frequency deviation-pulse duration product of the 
signal is sufficiently large. 

00 The autocorrelation function of an LFM signal has a lobed structure; the width of the 
main lobe decreases with the increase in the frequency deviation over the pulse. 


Review Questions 

1. Name the parameters adopted to define the degree of amplitude modulation. 

2. Explain the cause of the distortion occurring in the case of overmodulation. 

3. Define the cause of power redistribution in the spectrum of a single-tone AM signal. 

4. How are the frequencies of the carrier wave and of the modulating wave related to each 
other? 

5. Define the concept of the rotating phasor used to represent a single-tone AM signal. 

6. What is the fundamental difference between the waveforms of a DSB signal and of 
a conventional AM signal? 

7. Why is that the direct demodulation of an SSB signal results in the distortion of the 
transmitted signal? 

8. Outline the similarities and differences between FM and PM signals. 

9. State the relationship between the modulating frequency, modulation index, and fre¬ 
quency deviation. 

10. What is the spectral composition of FM and PM signals at low values of the 
modulation index? 


5-728 
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11. Explain the difference between the spectra of an AM signal and an FM wave at low 
values of the modulation index. 

12. Which property of Bessel functions indicates that angle-modulated signals occupy 
a limited bandwidth? 

13. How should the angle modulation index be chosen for the carrier to be absent from the 
modulated signal? 

14. What is special about the spectra of FM and PM signals in the case of a nonharmonic 
modulating wave? 

15. Draw the waveform of a rectangular LFM pulse. 

16. Explain the physical principle underlying the time compression of an LFM pulse. 

17. Draw an approximate plot relating the magnitude of the spectrum of an LFM wave to 
frequency. 

18. How is the frequency deviation-pulse duration product defined for LFM signals? 

19. Define the principal characteristics of the phase spectrum of an LFM signal. 


20. What is the shape of the autocorrelation 
envelope? 

21. What is the limitation of LFM signals 
autocorrelation function? 

Problems 

1. An AM wave is defined by 
m(*)=130x [1 + 0.25cos(10 2 f + 30°) 

+ 0.75cos(3 x \0 2 t + 45°)] x cos(10 5 t + 60°) 

Find the amplitudes and initial phases of all 
the spectral components and draw the 
spectral diagram of the signal. 

2. Draw a phasor diagram for the signal 
of Problem 1. Do this for time t = 0. 

3. The accompanying figure shows the 
waveform of a single-tone AM signal as 
displayed by a CRT oscilloscope. Suggest an 
experimental procedure for determining the 
modulation depth M from the waveform. 



Hint . Observe the instantaneous 
amplitudes of the signal at the extremal 
points. 


function for an LFM signal with a rectangular 
from the view-point of the structure of their 


4. Using the waveform of the AM signal 
shown in the figure find the initial phases of 
each of the components of the modulating 
wave. 


25° 



5. A load resistor of 75 Q, carries an 
amplitude-modulated current (A) defined by 

i(r) = 200(l +0.8cos4 x 10 3 t)cos6x 10 6 t 

Find: (a) the peak power delivered by the 
source; (b) the mean power dissipated in the 
load; and (c) the fraction of the total power 
concentrated in the carrier. 

6. An FM signal of 2.7 V amplitude has 
an instantaneous frequency varying as 

co(t) = 10 9 (1 + 10" 4 cos2 x 10 3 t) 

Find the modulation index and write 
a mathematical model of the signal. 

7. Determine the angle modulation index 
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for an FM signal, if the modulating fre¬ 
quency is F = 7 kHz, the carrier frequency is 
/ 0 = 180 MHz, and the peak value of fre¬ 
quency is /max = 182.5 MHz. 

8. Draw a spectral and a phasor diagram 
for an angle-modulated signal, if the carrier 
frequency is 45 MHz, the frequency 
deviation is 0.3 kHz, and the modulating 
frequency is 4.5 kHz. 

9. There is a single-tone PM signal, and 
the modulating frequency is Q=10 4 s” 1 . 
What should the frequency deviation be for 
the components at frequencies co 0 + Q to be 
absent from the signal? 

10. Draw a spectral diagram for an FM 
signal with an amplitude of 35 V and 
a modulation index of m = 3. 

11. The output signal from an FM 
transmitter in the absence of the carrier is 
250 V. Measurements show that when 
a single-tone modulating signal is applied to 
the transmitter, the output voltage rises to 
244 V. Find the frequency modulation index. 
May it be assumed that narrowband FM is 
implemented under the conditions stated? 

12. A PM radio broadcasting station is 
operating at a maximum modulation index 
of 30 (at the maximum volume of the 
transmitted signal). Assuming that the upper 
frequency limit of the modulating wave is 
16 kHz, find the number of radio channels 
that can be accommodated within the VHF 
band (30-300 MHz) without cross¬ 
interference. 

13. The input circuit of a radio receiver 



contains a resonant circuit tuned to a carrier 
frequency of f 0 = 64 MHz. The Q-factor of 
the tuned circuit is 30. Can this circuit be 


used for the reception of an FM signal 
whose frequency varies as 

f(t)=f 0 ( 1 +0.015 cos 2.8 x 10 3 0 

14. An LFM signal with a rectangular 
envelope has an amplitude of U 0 = 10 V, 
a duration of x p = 15 ps, and a frequency 
deviation of 40 MHz over the pulse 
duration. Find: (1) the frequency 
deviation-pulse duration product of the 
signal; (2) the quadratic term of the phase 
spectrum at the boundary of the bandwidth 
occupied by the signal; and (3) the power 
spectrum of the signal. 


Advanced Problems 

15. Analyse how the difference in 
amplitude between the upper and lower side 
waves affects the envelope of an AM signal. 
Consider a single-tone signal with a spectral 
diagram of the form shown in the 
accompanying figure, 

U Q 

T kMUo/2 

T 

MU 0 /2 

T I I 

o) 0 —Q u> 0 u> 0 +Q 

assuming that k ^ 1. 

16. Analyse how the failure to observe the 
constraints imposed on the upper and lower 
side frequencies affects the envelope of an 
AM signal. Assume that the two side waves 
have the same amplitude. Consider 
a single-tone signal in which the lower side 
frequency is coi s = co 0 — D, whereas the upper 
side frequency is a> U s = co 0 + D + 5, where 
5«£L 

17. Apply spectral analysis to the 
envelope of a single-tone SSB signal of the 
form defined by Eq. (4.18). Propose 
a numerical estimate for the degree of 


5 * 










































132 


Part One. Signals 


distortion in the envelope of the signal. 

18. The total phase of a two-tone FM 
signal varies as 

x ¥(t) = 2n x 10 8 £ + 0.12 sin 2n x 10 4 t 
+ 0.08 sin 4n x 10 4 t 

The amplitude of the unmodulated carrier is 
U 0 = 75 V. Find how the amplitude of the 


carrier will change upon the application of 
modulating signals. 

19. It is known that one of the methods 
to improve the correlation properties of 
LFM signals is to use nonlinear instead of 
linear modulation. Referring to Chap. 3 in 
[21], examine the spectrum of such complex 
signals. 


Chapter 5 

Band-Limited Signals 


As we have learned in Chap. 2, for the complete recovery of 
a signal from its spectrum it would be necessary to consider all of 
its components at frequencies from zero to infinity. This is 
unfeasible for physical reasons. Also, as co goes to infinity, the 
contributions from the various spectral components grow negligibly 
small owing to the properties of the signals whose energy is finite. 
Finally, any real device designed to transmit and process signals 
has a finite bandwidth. This becomes especially evident in the case 
of frequency-selective filters. 

In this chapter we will deal with a special class of signals whose 
spectrum is nonzero only in a frequency interval of finite width. 
They are aptly called band-limited. 


5.1 Some Mathematical Models and Properties of 
Band-Limited Signals 

Let D be a finite frequency interval. Then the spectrum of 
a band-limited signal will be 

S(o))^0 if co eD 

5 (co) = 0 for any other values of frequency 

The most general mathematical model for a band-limited signal 
can be derived from the Fourier inversion formula: 


s ( t ) = —f S (co) exp (/cot) dco (5-1) 

2k d 

Depending on the choice of the frequency interval D and of the 
spectrum S(oo), we can obtain a large variety of band-limited 
signals. 

The ideal low-pass signal. Consider a wave whose spectrum has 
a constant real term in a frequency interval limited to some upper 
frequency co u ; outside that interval the spectrum of the signal is 
zero 


S((o)=\ 


0, co< — co u 

Sn, — COu ^ COu ^ COu 

0, CO > C0 U 

The instantaneous values of the signal are 

® u S 0 co u sin co u t 

s(t) = (S 0 /2n) J exp (/cot) dco =- 


(5.2) 


S 



-l»>u 0 U>u 



n (D u t 


(5.3) 
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The ideal low-pass 
signal 



s 

Sq<jJ u/TI 


Let us call this wave the ideal low-pass signal. Thus we 
underscore the fact that it has the simplest spectrum among all the 
other signals of this kind. 

The plot of the ideal low-pass signal constructed on the basis of 
Eq. (5.3) yields an oscillating curve which is even about the time 
origin. As the upper frequency limit of the spectrum is raised, the 
central peak and the frequency of oscillation increase too. 

A more general ideal low-pass signal can be obtained by 
assuming in Eq. (5.2) that the phase of the spectrum is a linear 
function of frequency 


Solve Problem 1 


f 0, (D < - C0 U 

S (co) = < S 0 exp (- jcot 0 ), - co u ^ CO ^ (Ou (5.4) 

l 0, CO > COu 

Here t 0 is a parameter defining the time shift of the wave such that 
the spectrum in (5.4) corresponds to the low-pass signal defined by 


S 0 co u sinco u (t — t 0 ) 

s (t) =- 

71 C0 U (t — t 0 ) 



A 

The ideal bandpass 
signal 


The ideal low-pass signal is an idealized representation of the 
response of a low-pass filter excited by a wave whose spectrum is 
the same over all frequencies, which is recognized as the delta- 
impulse. In this representation, it is assumed that the frequency 
response of the low-pass filter is approximated with sufficient 
accuracy by a rectangular function having the specified upper fre¬ 
quency limit. 

The ideal bandpass signal. Analyse the mathematical model of 
a bandpass signal whose spectrum is limited to a frequency band of 
width BW = 2Aco, centred at ± co 0 . If within that band the 
spectrum of the signal is constant: 

I S 0 , — co 0 — Aco < co < - co 0 -I- Aco 

co 0 - Aoo < co < co 0 + Aco (5.5) 

0, outside the band 

then, by analogy with the previous case, we shall call this signal the 
ideal bandpass signal. 

The instantaneous values of an ideal bandpass signal can be 
found, using the inverse Fourier transform: 

ca /c / “°t Aco 2<S 0 Aco sin Acot 

s(t) = {S 0 /n) J cos cot dco =---cosco 0 t (5.6) 

co 0 — A© 71 ACO t 

The structure of an ideal bandpass signal is illustrated in the 
accompanying plot. As is seen, the r.f. oscillations at co 0 are 
accompanied by time variations in their instantaneous amplitudes. 
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The function sin (Aoot)/(Acof) represents the slowly varying envelope 
of the ideal bandpass signal to within the scale factor 2<S 0 Aco/tc. If 
Aco/co 0 «l, that is, if the relative bandwidth of the ideal bandpass 
signal is substantially less than unity, the envelope varies much 
more slowly than the r.f. carrier. 

A method, at least theoretical, to generate an ideal bandpass signal 
is obvious: We should apply a broadband excitation such as the 
delta-impulse to the input of an ideal bandpass filter which transmits 
only frequencies within the interval [co 0 — Aco, co 0 + Aco]. 

Estimating some parameters of a band-limited signal. From an 
analysis of the equations derived in the previous section, it would 
be seen that the peak values of the signals involved are directly 
proportional to their bandwidth. On the other hand, as the 
bandwidth of a signal is reduced, the signal (or its envelope) varies 
with time progressively more slowly. 

It is an easy matter to develop numerical characteristics which 
would define the limiting values for the energy, amplitude and 
derivative of a band-limited signal in general form. 

Let, for example, s ( t ) be a signal whose spectrum is nonzero only 
within the frequency band — a> u ^ co ^ co u . Then the following 
estimate of the signal energy is obvious: 


© u 



S (to) S* (©) dco < ((Du/n) Smax 


— © u 


(5.7) 


where S max is the maximum magnitude of the spectrum. 

Let us find the limiting value of the signal amplitude. By the 

inverse Fourier transform 

* 

00 


▲ 

Work 



— 00 


S'(cd) exp (jcot) dco 


the maximum value of a signal is limited from above to a value 
equal to the sum of the magnitudes of all complex amplitudes 
corresponding to elementary intervals on the frequency axis. Since, 
on the basis of Eq. (2.17), the frequency interval of width Aco, 
forming the neighbourhood around the chosen frequency, is 
characterized by a complex amplitude 


AT co =—S(co)Aco 

K 


it follows that the instantaneous value of the signal in question 
satisfies the inequality 

Smax ^ ((Ou/7t)S max (5.8) 


The “ = ” sign applies only when the signal is of the ideal low-pass 
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type: Its spectrum must be constant within the bandwidth and also 
all spectral components must be able to combine coherently at 
some instant of time. 

Now it is easy to develop an estimate of the time derivative. We 
take the limit of the relation 


Jim s(t +At)-s(t) 
At —► 0 At 


= lim 
At-+0 


At 


<o u 


S (cd) [exp (jcoAt) 


i] 


x exp(;cDt)dco 

and note that 
exp (/co At) — 1 « jcoAt 

for At going to zero. By analogy with the previous case, we obtain 
the following inequality 

I ds/dt | m ax ^ O^uA^Smax (5*9) 


Orthogonal band-limited signals. The constraints imposed on the 
bandwidth of a signal permit us to find interesting and important 
classes of orthogonal signals. The simplest example is the ortho¬ 
gonality of two bandpass signals whose spectra exist in 
non-intersecting domains. That the scalar product of these signals is 
equal to zero stems directly from the generalized Rayleigh formula. 

The orthogonality is less obvious in the case of band-limited 
signals shifted in time relative to one another. 

Consider two ideal baseband signals u(t) and v{t). Their S 0 and 
co u are the same, but the signal v(t) lags behind the signal u(t) by 
a time t 0 such that its spectrum is defined by 

5 y (co) = S u ( co) exp ( —j(ot 0 ) 


The scalar product of the two signals is 

(0 U 



exp (j(ot 0 ) dco = 


Si co u sinoo u t 0 
K CDu to 


(5.10) 


— CDu 

As follows from Eq. (5.10), two ideal baseband signals identical 
in waveform are orthogonal if the time shift between them satisfies 
the condition 


co u t 0 = kn, k= ± 1, ±2, ... 


(5.11) 


The minimum time shift just sufficient for the signals to be ortho¬ 
gonal occurs at k = ± 1 and is equal to 


to — i (tc/cou) — i l/?/u 


(5.12) 
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A fact of fundamental importance is not only that two signals are 
made orthogonal. We have formed an infinite orthogonal basis 
which can serve as a coordinate system for the expansion of an 
arbitrary signal whose spectrum does not contain any frequencies 
above oo u . 

Plots of the signals involved appear in Fig. 5.1. 




Fig. 5.1 Plots of two ideal baseband signals shifted in time for t 0 = n/(o h 
and t 0 = 27r/cOh 

Another important fact is this: When one of the signals reaches 
an absolute maximum, all the other signals in the set cross zero. 


5.2 The Kotelnikov Theorem 


This theorem*, proved by Kotelnikov in 1933, is one of the 
fundamental postulates of communication theory. It provides for 
the recovery of the instantaneous values of a band-limited signal to 
any desired accuracy from its samples taken at equal time intervals. 

Construction of an orthonormal basis. As has already been 
shown, any two band-limited signals belonging to the set 


uk(t) = A 


sin co u (t — kn/ co u ) 
(o u (t - kn/(o u ) 


, fc = 0, ±1, ±2, ... 


(5.13) 


are orthogonal. Through the proper choice of the amplitude 
coefficient A we can make the norm of each of these signals equal 
to unity. The result will be an orthonormal basis for the expansion 
of an arbitrary band-limited signal into a generalized Fourier series. 

We shall limit ourselves to the function 


Academician V. A. Ko¬ 
telnikov is a promi¬ 
nent Soviet scientist in 
the field of telecommu¬ 
nications and radio 
physics 


«o(0 


A 


sin o 
co u t 


because the norm of any signal uu is the same, irrespective of the 


* It is usually called the sampling theorem outside the Soviet Union. 
- Translator's note. 
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time shift. Since 


Noll 2 = (A 2 /cog) 


sin 2 co u t 


dt = nA 2 /a> u 


then the functions uk will be orthonormal if 


A = y C0 U /7C 

The infinite set of functions 
c , ^ i / —T sin °° u (f ~ ^/®u) 

SCk(t , C0 U ) — ]/C0 u /7l - - - - 

COu (t - /cTU/COu) 


(5.14) 


, form the so-called Kotelnikov basis on the linear space of low-pass 

signals limited in frequency from above by the upper limiting fre¬ 
quency, co u . An individual function Sck(t ; co u ) is called the kth 
sample function. 

The Kotelnikov series. If s (0 is an arbitrary signal whose 
spectrum is nonzero only within the frequency band — co u < co < 
< G) u , it can be expanded into a generalized Fourier series in terms 
of the Kotelnikov basis, that is, represented as 


s(t)= £ ckScift, co u ) 

fc= -00 


(5.15) 


The coefficients of the Kotelnikov series are the scalar products 
of the signal being expanded and the kth sample function: 


ck=[s(t), Sck(t , co u )] 


(5.16) 


These coefficients can conveniently be determined by using the 
generalized Rayleigh formula. It is easy to verify that within the fre¬ 
quency interval (— co u ^ co ^ co u ) the kth sample function has 
a spectrum equal to yn/(o u exp( - ja)kn/(o u ). It is obvious from 
a comparison of Eqs. (5.3) and (5.14). Then, if <S(co) is the spectrum 
of the transmitted signal s(t\ we find that 


c k 


= yVoou 


i 

2tu 


uj u 

J 


The expression in 
instantaneous value 

tk = /ctc/cou = k/2f u 


S (co) exp (//c7cco/co u ) dco J 

the square brackets 
of s (tk) = Sk at the 


(5.17) 

is nothing but the 
kth sampling point: 


Thus, 

Ck = ]/n/(o u Sk 
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Hence, the final expression for the Kotelnikov series is 


(5.18) jY\e statement of the 
Kotelnikov theorem 

On the basis of Eq. (5.18), the Kotelnikov theorem may be stated 
as follows: An arbitrary signal band-limited to frequencies not higher 
than f u Hz can be completely recovered from its samples taken at 
equal sampling intervals 1/(2 f u ) seconds apart. 


Example 5.1. Let there be a signal s(t) = cos co u £. The samples of 
the signal are defined by 

Sk = cos (co u tk) = cos (kn) = (- \) k 

Hence, it is seen that the harmonic waveform at the highest fre¬ 
quency allowed by the Kotelnikov theorem is represented by two 
samples per period. If the initial phase of the signal is zero, then the 
samples are equal in magnitude, but their signs alternate. The 
Kotelnikov theorem permits us to write the following 
representation of the harmonic signal, which does not appear 
obvious at first glance: 

00 

Z f sin co (t - 2 kn/( 0 ) sin co[t - (2k + 1) tc/co] ~| 

{ co(t — 2 /c7t/co) £0[t-(2fe+l)7l/©] J 

fc= — 00 

If, on the other hand, the requirement of the Kotelnikov theorem is 
not observed and samples are taken not frequently enough, the 
recovery of the signal in accord with Eq. (5.18) is accompanied by 
an error which may be considerable. For example, the samples may 
be s/ c = (-l) /c , as in the previous case, but the signal whose 
spectrum contains frequencies higher than co u will have a more 
complex structure than a harmonic wave. 


Hardware for the synthesis of signals represented by the 

Kotelnikov series. A valuable advantage of the Kotelnikov theorem 
is its constructive character. It not only states the fact that a signal 
can be expanded into a suitable series, but also defines the method 
by which a continuous signal can be recovered from its samples ^ 

(Fig. 5.2). Solve Problem 6 

Let there be a set of generators producing sample functions 
Sck(t; CD U ) across their output terminals. The generators are of the 
controlled type-the amplitudes of their output signals are 
proportional to the samples s*. If, now, we combine the output 
waves by applying them to an adder, the adder output will, in 



5(0= Z s k 

k= — oo 


sinco u (t — kn/(o u ) 
CD U (t — ku/(£)u) 





















































140 


Part One. Signals 



Fig. 5.2 Set-up for the synthesis of a signal from its Kotelnikov series 

accord with Eq. (5.18), be the instantaneous value of the signal 
being synthesized, s{t). 

An approximate representation of signals by means of the 
Kotelnikov series. Cases may arise in which it is known in advance 
that the greater proportion of the energy of a signal having an 
unbounded bandwidth is concentrated in the low-frequency portion 
of the spectrum. Such signals can approximately be represented by 
the Kotelnikov series. 


Example 5.2. A rectangular video pulse of unit amplitude and of x p 
duration is not band-limited , yet the magnitude of its spectrum 
decreases with increasing frequency at a sufficiently high rate (as 1 /go). 

If we represent the signal with two samples one taken at the start 
and the other at the finish of the pulse, its spectrum will include all 
the components up to the highest frequency co u = 7r/x p . Using 
Eq. (5.18), we find an approximate mathematical model for the 
signal: 


sin (nt/xp) sin (tc/x p ) ( t - x p ) 
nt/Tp (n/xp) (t - Xp) 


(5.19) 


If we represent the same signal with three equidistant samples, we 
will, as can readily be seen, include all frequencies up to co u = 2 tt/t p . 
Therefore, 

(t) = (27t£/T p ) sin (2tc/x p ) (t - x p /2) 

27 it/xp (2tc/x p ) ( t - x p /2) 


sin (27i/x p )(t - x p ) 
(27i/x p )(t - x p ) 


(5.20) 




t 


The corresponding plots appear in Fig. 5.3. 

Naturally, the accuracy of the approximation will improve as we 
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Fig. 5.3 Approximation of a video pulse: (I) with two members of the 
Kotelnikov series; (2) with three members of the Kotelnikov series 


take more samples, that is, as we reduce the time spacing between 
the samples. 


The error in the Kotelnikov series approximation of an arbitrary 
signal. If s(t) is an arbitrary signal, it may be represented as a sum 

s(t) = s b \(t, CD U ) + S e (0 


where sb\(t, cq u ) is a signal band-limited to the highest frequency co u , 
and s e (t) is the approximation error signal occupying an unlimited 
frequency band co>co u . 

Their spectra do not overlap, so sbi and s e are orthogonal, and 
their powers, that is, their norms squared, combine. 


|| S || 2 = ||Sbl|| 2 + II Sell 2 

The absolute measure of the approximation error is the distance 
equal to the norm of the error signal. If fF s (co) is the power 
spectrum of s(t), then by the Rayleigh theorem 


II Sell = 


OO 



11/2 


Wsi co)dco 


CD U 


(5.21) 


|S| 





Example 5.3. There is an exponential video pulse s(t)- 
exp ( — at) a (t), for which the power spectrum is 


= 1 /(oc 2 -f- co 2 ) 


and the power is 


II s 


I 2 _ 


1 

n 


dco 

(a 2 + co 2 ) 


1 

2a 


o 
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The effective duration of the pulse (see Chap. 2) is 
ip = 2.3026/a 

Suppose that the samples are taken at a rate such that in the 
time ip a total of ten samples are made available, spaced apart 

t 0 = 2.3026 4- 9a = 0.2558/a seconds 

By the Kotelnikov theorem this means that the adopted sampling 
procedure includes all frequencies up to 

co u = n/t 0 = 12.281a 


Hence the norm of the error signal is 

00 


II Sell = 


"1 

dco 

1/2 

-_L| 

( « 

arrtan “ U ^ 

7t 

a 2 + ca 2 


arc ' 

4 

— drcidn- 1 

a )\ 


Since 

II s II =0.707 14 /a 


0.1608/14 



Here the theoretical 
minimum of the error 
is meant 


it follows that the relative approximation error is 

|| s e II / II5 II = 0.1608 4 - 0.7071 = 0.2274 Work Problem 7 

As is seen, the adopted sampling rate is not high enough for the 
approximation to be sufficiently accurate. 


Dimensionality of the space of band- and duration-limited 

signals. As follows from the examples given in Chap. 2 to 
demonstrate the calculation of the spectrum of pulse signals, 
theoretically any signal of finite duration has a spectrum extending 
along the frequency axis without bound. In mathematics, this 
statement is proved rigorously and in the general form. 

For practical purposes, however, it is customary to consi¬ 
der idealized models of signals limited in duration as well as in 
bandwidth. Such models can fairly accurately represent the signals 
existing in real communication channels. 

Let T be the duration of such a signal, and f u be its upper fre¬ 
quency limit or, which is the same, its bandwidth in hertz. Then the 
bandwidth-duration product of the signal (see Chap. 4) will be 

BW = Tf u 

For this signal to be described completely (albeit approximately for 
the reasons just stated), we must take a number N of independent 
samples, such that N = T/t 0 = 2Tf u . This expression defines the 
dimensionality of the space of band- and duration-limited signals. 

As a rule, the number N is fairly large. For example, in order to 
represent a radio broadcasting signal band-limited to a frequency of 
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12 kHz and duration-limited to 1 min, we shall need 
2 x 60 x 1.2 x 10 4 = 1.44 x 10 6 
independent numbers. 

In his time, Claude Shannon proposed a convenient technique for 
interpreting duration- and band-limited signals, consisting in that 
each such signal is represented by a single point in 
a finite-dimensional Euclidean space of dimensionality 2T/ U . Now 
the sample Sk appears as a projection of the representative point on 
the /cth coordinate axis. Because the space has an Euclidean metric 
and the coordinate axes are mutually orthogonal, the length of the 
signal vector is 
2 T/ u 

r s = ( I 4) 1/2 < 5 ' 22 ) 

k= 1 


The quantity r s can be expressed in terms of the signal energy E s in 
the following way. Since 

2 T/ 0 . 2 Tf u 

14 - 27-14 

k= 1 4 /u k= 1 

then it follows that 


r s =\nEJ u = \/2Tf u P m (5-23) 

where P m is the mean power of the signal. Hence, any signals with 
fixed parameters T and f u , the mean power of which does not 
exceed P 0 , are represented by points lying within 
a multidimensional sphere of radius 

p(P 0 ) = \/2Tf u P 0 (5-24) 

It should be noted in conclusion that the statement of the 
Kotelnikov theorem may be somewhat extended [18]. It is true that 
for a finite-dimensional representation of the signal type in question 
we need 2 Tf u samples. It is not mandatory, however, to require that 
the samples be equidistant in time. Also, we may halve the 
sampling rate, but at each point we should measure both the 
instantaneous value of the signal and its first derivative. 


5.3 Narrowband Signals 

This section will be concerned with a special class of 
band-limited signals which appear at the output of frequency- 
selective circuits. By definition, a signal is called narrowband if its 
spectrum is non-zero only within the frequency bands of width BW, 
in the neighbourhood of points ±co 0 , such that BW/co 0 «l. 

As a rule, the frequency co 0 , called the reference frequency of the 


In information theory, 
the dimensionality of 
signal space is a mea¬ 
sure of message con¬ 
tent 


It is assumed that 

coo^O 

• 

The reference fre¬ 
quency 
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signal, may be taken as being the same as the centre frequency of 
the spectrum. In the general case, however, its choice is sufficiently 
arbitrary. 

The mathematical model of a narrowband signal. A straight¬ 
forward approach to forming a mathematical model for 
a narrowband signal is as follows. As will be recalled (see Chap. 2), 
if /i (t) is a low-pass signal whose spectrum is concentrated in the 
neighbourhood of co 0 , then the wave 

s i(0=/i (0 cos o) 0 £ 


will possess all the necessary properties of a narrowband signal 
because its spectrum will be concentrated near the points ±co 0 . 
The same is true of the signal 

s 2 W=/ 2 (0 sin o 0 t 


which only differs in the phase of the “fast” term. The most general 
expression for the mathematical model of a narrowband signal can 
be derived by analysing the following linear combination 


The in-phase and quad¬ 
rature amplitudes 



s ( t ) = A s (0 cos co 0 t - B s ( t ) sin co 0 t (5.25) 


The two time functions, A s (t) and B s {t\ are of low frequency 
character in the sense that they change only slightly over a period 
of the high-frequency wave, T=2n/a> 0 . Customarily, the function 
A s (t) is called the in-phase amplitude of a narrowband signal, s(t), 
for a specified reference frequency co 0 , and the function B s {t) is 
called its quadrature amplitude. 

Experimentally, the instantaneous values of A s (t) and B s (t) can 
be determined as follows. If we apply the narrowband signal s ( t ) to 
one input of a multiplier (mixer) and an auxiliary wave varying in 
time as cosco 0 t, to the other input, the output will be the signal 

Uout ( t ) = A s (t) cos 2 co 0 t~~ B s (0 sin 2co 0 t 


= A s (t)/2 + [A s (0/2] cos 2co 0 t - [J3 S (0/2] sin 2co 0 t (5.26) 



Now let the output signal be applied to a low-pass filter, LPF, 
which suppresses frequencies of the order of 2co 0 . Obviously, the 
output of the low-pass filter will be a low-frequency wave 
proportional to the in-phase amplitude A s . The quadrature 
amplitude B s (t) of the narrowband signal s(0 can be extracted if we 
apply another auxiliary wave sin co 0 t to the second input of the 
multiplier. 

The complex representation of narrowband signals. It is a widely 
accepted fact that many problems in the theory of linear circuits 
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can be tackled by the method of complex amplitudes. By this 
method, a harmonic wave is represented as the real or the 
imaginary part of a complex function: 

U 0 cos (gV + cp 0 ) = Re [U 0 exp (/cp 0 ) exp (/co o 0] 

U o sin (co 0 t + cp 0 ) = Im [U 0 exp (/cp 0 ) exp (jco 0 t )] 


The time-invariant number U = C/ 0 exp(/cp 0 ) is called the complex 
amplitude of the harmonic wave. 

From a physical point of view, narrowband signals are quasi¬ 
harmonic waves. Therefore, it is natural to try to generalize the 
method of complex amplitudes to signals of the type (5.25). 
Let us introduce a complex low-frequency function 

Us(t) = A s (t)+jB s (t) (5.27) 


The complex enve¬ 
lope 


called the complex envelope of a narrowband signal. It is easy to 
verify that 

5 ( t) = A s cos co 0 t - B s sin (o 0 t = Re [ U s (t) exp (/co o 0] (5.28) 

Thus, for a narrowband signal, the complex envelope is the same 
as the complex amplitude for a simple harmonic wave. However, 
the complex envelope is, in the general case, time-dependent, 
because the phasor U s (t), as it moves about in the complex plane, 
varies in both magnitude and position. 




Example 5.4. A narrowband signal s(t) is a harmonic wave at t < 0 
and t> 0, but at t — 0 its frequency undergoes a step change: 

* { U 0 cos co 0 t, t< 0 

s(t) = { 0 0 

(U qCOsco^, t> 0 


Taking co 0 as the reference frequency, we obtain the following 
expression for the complex envelope of the signal: 


U s (t) = 


U 09 t< 0 

U 0 exp [j (©! — co 0 ) t \, t >0 


It is important to stress that the choice of the reference frequency is 
fairly arbitrary and dictated by mathematical convenience. For 
example, if the reference frequency is chosen to be (oo 0 + coJ/2, the 
complex envelope of the signal in question will have the form 


[7 0 exp (j — mi t < 0 

t/ 0 exp^--*-- ~ m ° t j, f > 0 


U s (t) = 
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In dealing with modu¬ 
lated signals we have 
been using precisely 
this concept of the 
envelope 


A 

Solve Problems 8-10 


The physical envelope, the total phase, and the instantaneous fre¬ 
quency Equation (5.27) defining the complex envelope may be 
re-cast in exponential form: 

U ( t ) = Us (t) exp [;cp s (t)] ( 5 - 29 ) 


Here, U s (t) is a real, nonnegative function of time, called the 
physical envelope (or, simply, the envelope)-, cp s (t) is the slowly 
varying initial phase of the narrowband signal. The two quantities 
are related to the in-phase and quadrature amplitudes: 

A s (t) = U s (t) cos (p s (t) ( 5 - 30 ) 

B s (t)= U s (t) sin cp s (t) 

Hence, we derive one more useful form for the mathematical model 
of a narrowband signal 

s (r)= [/ S (t)cos[co 0 f + (p s (t)] (5.31) 

As we have already done in connection with angle modulation, 
we introduce the total phase of a narrowband signal 

\|/ s (t) = co 0 t + tp s (f) 

and define the instantaneous frequency of the signal as the time 
derivative of the total phase: 

(o s (t) = co 0 + d<p s /dr (5-32) 

In accordance with Eq. (5.31), a narrowband signal is, in the 
general case, a complex wave produced by modulating the 
harmonic carrier both in amplitude and in phase. 

The physical envelope of a narrowband signal and its properties. 

On the basis of Eq. (5.30), let us write a formula relating the 
physical envelope U s (t ) to the in-phase and quadrature amplitudes: 

U s (t) = ]/Af+Bl (5.33) 

(The arithmetic value of the root is taken.) 

As already noted, there is more than one way to define the 
complex envelope of a narrowband signal. If, instead of the fre¬ 
quency co 0 appearing in Eq. (5.28), we take some other frequency, 
co 0 '= co 0 + Aco, then the signal s(t ) will be defined by 

s (0 = Re [ U s (t) exp (- jAcot) exp (;cd 0 '£)] 
and its complex envelope will take the form 


U s ' (t) = U s (t) exp ( — ;Acot) 


(5.34) 
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Meanwhile, however, the physical envelope, which is the magnitude 
of the complex envelope, will remain unchanged, because the term 
exp(—yAcot) has a magnitude of unity. 

Another important property of the physical envelope consists in 
that at each instant of time 

\s(t)\^U s (t) 

The validity of the statement stems directly from Eq. (5.31). The 
“ = ” sign applies at the instants when 

cos [co 0 t + cps(t)] = 1 

But the derivatives of the signal and of its envelope are the same: 
s'(t) = U' s (t) cos [co 0 t + cp s (0] 

- Oo + cps(0] U s (t)sin [gV + cpsW] 



The envelope of a 
narrow-band signal 


Therefore, the physical envelope does “enclose” the narrowband 
signal and has the meaning of its instantaneous amplitude. 

The concept of the envelope is of important significance to 
telecommunications because in practice wide use is made of special 
devices, called amplitude detectors (demodulators), which are capable 
of re-creating the envelope of a narrowband signal with high 
fidelity. 

Properties of the instantaneous frequency of a narrowband signal. 

If the complex envelope of a narrowband signal is represented by 
a phasor which rotates in the complex plane at a constant angular 
velocity Q, that is, 



U s (t) 







U s (t)= U s (t) Qxp(±jClt) 

then, in accord with Eq. (5.32), the instantaneous frequency of the 
signal must be constant in time: 

= co 0 ± Q A 

It may be argued that this signal is a harmonic wave modulated ^ 

only in amplitude, but not in phase. Among other things, if one of 
the amplitudes, A s or B s , reduces identically to zero, then the 
instantaneous frequency at any time will be co s = co 0 . 

In the general case, however, the instantaneous frequency varies 
with time in the following manner: 


co s (t) = cd 0 + — arctan (B s /A s ) = co 0 + 
at 


Bs A s — A s Bs 
A 2 S + Bs 


(5.35) 


Relationship between the spectra of a narrowband signal and of 

its complex envelope. Let G 5 (co) denote the spectrum of the 
complex envelope of a narrowband signal, 5 (t). The spectrum of the 
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signal itself is 


00 

S(co) = j Re[U s (t)exp(j(£) 0 t)~]exp(—j(ot)dt 

— 00 

1 00 ~ 

= — J U s exp [ — 7 (© — ©o) t] dt 

^ -00 

1 °° ~ 

+ y J Us exp [ — j (co + co 0 ) t] dt 
^ -00 

= y G s (co - co 0 ) + Y G*s (- CO - co 0 ) (5.36) 


Thus, the spectrum of a narrowband signal can be found by 
translating the spectrum of its complex envelope from the neigbour- 
hood of the zeroth frequency into the neighbourhood of points 
±co 0 ; the amplitudes of all spectral components are halved, and 
the negative-frequency spectrum is obtained by taking the complex 
conjugate of the positive-frequency spectrum. 

Using Eq. (5.36), we can find the spectrum of the complex 
envelope of a narrowband signal from the known spectrum of the 
signal itself, and then determine the physical envelope and the 
instantaneous frequency of the signal. 


S(a>) 


©>o 


Example 5.5. Analyse a narrowband signal , s(t), whose spectrum is 
asymmetrical about the frequency co 0 : 

' (S 0 / 2) exp [ - b (co - co 0 )], co > co 0 
0 , 0 < co < co 0 

On the basis of Eq. (5.36), the spectrum of the complex envelope is 
' S 0 exp( — bco), co>0 
0 , co < 0 

Using the inverse Fourier transform, we get 


G s (co) = 


U s (t) = (S 0 /2n) | exp (- b +jt) co d<o = (SJ2n) [1/( b - jt )] 


|S| 

..So/ 2 


\ 


—u> 0 0 u>0 


I O s ( ) | 

V 


0 


The in-phase and quadrature amplitudes of the signal respectively 
are 

A s (t) = (S 0 /2n)b/(b 2 + t 2 ) Solve Problem 12 


and 

B s (t) = (S 0 /2n) t/(b 2 + t 2 ) 
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The physical envelope is 

[7 s (t)= I t/ s (t)l =(S 0 /2n)(\/]/b 2 + t 2 ) 

The instantaneous frequency of the signal 

co s ( t ) = co 0 + arctan (t/b) = co 0 + b/(b 2 + t 2 ) 

at 

is a maximum, co 0 + 1 /b, at time t = 0. 

The waveform of the signal in question is a symmetric radio 
pulse whose carrier varies with time. 


5.4 The Analytic Signal 
and the Hilbert Transform 

In this section we will discuss one more method for the complex 
representation of signals, frequently used in theoretical studies. 
A distinction of the method is that the concepts of the envelope and 
of the instantaneous frequency of a signal can be introduced 
without the degree of uncertainty inherent in the method of 
complex envelopes. 

The analytic signal. Euler’s formula 

cos o ot = [exp (/cot) + exp (— j(otf\/2 

representing a harmonic wave as a sum of two complex conjugate 
functions suggests that an arbitrary signal s(t) with a known 
spectrum S(co) can be uniquely defined as a sum of two components 
each of which contains only positive or only negative frequencies: 



00 

5(co) exp(/cot)dco 


— 00 


0 


00 


1 

2n 


S (co) exp 0‘cot) dco + —— 
2n 

o 


S (to) exp (/cof) do) 


Let the function 


(5.37) 


Zs(0 = - 


S^cn) exp (/cot) dco 


(5.38) 


be called the analytic signal corresponding to a real signal s(t). 
By a change of variables, \ = - co, the first integral on the right- 
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hand side of Eq. (5.37) can be re-arranged as 
o o 


ij 


S(co)exp (jot) dco 




Qexp(-fy) dE, 


1 

2k 


s (- S) exp ( -j%t) = — z*s ( t ) 


Therefore, Eq. (5.37) relates the signals s(t) and z s (t) as 
s(t)= [z s (t) + ^(t)]/2 


or, which is the same, 


s(t)= Re [z s (t)l 


(5.39) 


The imaginary part of the analytic signal 


s(t) = Im [z s (t)] 


(5.40) 


The conjugate signal 



is the conjugate of the original signal s(t). 

Thus, the analytic signal 

z s (t) = s(t)+js(t) (5.41) 

is represented in the complex plane by a rotating phasor whose 
magnitude and phase angle vary with time. The projection of the 
analytic signal on the real axis at any time is equal to the original 
signal s(t). 

By introducing the concepts of the analytic and the conjugate 
signals, we cannot derive any new information that is not contained 
in the mathematical model of the signal s(t). However, these two 
concepts open a direct road to a systematic approach to the 
analysis of various signals, especially narrowband waves. 

Now we shall demonstrate how the analytic signal can be found 
from the known spectrum of the original signal. 


Example 5.6. Let s(t) be an ideal low-pass signal of known S 0 and 
co u (see Sec. 5.1). 

Then the analytic signal is 

G) u 

Zs(t) = (S 0 /jz) J exp (Jcot) dco = (S 0 /jKt) [exp (J(Q u t) - 1] 

0 

On splitting the above expression into its real and imaginary 




s 


1 

f 




—U>u 0 U) u 
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- 0.4 

- 0.6 


Fig. 5.4 Original and conjugate signals: ( 1 ) ideal baseband signal; (2) 
conjugate signal 


parts, we obtain 

sinco u t 

s(t) = (S 0 o u /n) - 

O u t 

(which is a previously known result), and 
s(t) = (S 0 o u /n) sin 2 (o u t/2)/(o u t/2) 

Plots of the signals are given in Fig. 5.4. 

The spectrum of the analytic signal. Let us analyse the spectrum 
of the analytic signal, that is, the function Z s (o) from which we can 
find z s (t) by using the inverse Fourier transform: 



— 00 


Z s (cg) exp (jot) dco 


On the basis of Eq. (5.38), we may argue that this function is 
non-zero only in the region of positive frequencies: 


Z s (o) = 


2 S( co), 

0, 


co > 0 
co < 0 


(5.42) 


If S(co) is the spectrum of the conjugate signal, then, owing to the 
linearity of the Fourier transform, we may write 

Z s (co) = S(co) + jS (co) (5.43) Solve Problems 13 

and 14 

Therefore, the equality in (5.42) will be fulfilled only when the 
spectra of the original and of the conjugate signals are related in 
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Quadratic filter 


the following manner: 

S(c)-’ r jsgn(«>)S(«>)-j (5.44) 

where sgn(co) is the signum function. 

Abstractedly, we can imagine the following method for deriving 
the conjugate signal: The original wave s(t) is applied to the input 
of a system which rotates the phases of all the positive-frequency 
spectral components through — 90° and of all the negative-fre¬ 
quency components through an angle of 90° without changing their 
amplitudes. The structure possessing such properties is called the 
ideal quadratic filter. 

The Hilbert transform. Equation (5.44) shows that the spectrum 
of the conjugate signal is the product of the spectrum S( oo) of the 
original signal and the function — j sgn(oo). Therefore, the conjugate 
signal is the convolution of two functions, s(t) and /(£), and this 
convolution is the inverse Fourier transform of — 7Sgn(oo). 

For mathematical convenience, let us represent the function 
—;sgn(co) as the following limit: 

-j sgn (©) = lim [ -j sgn (co) exp (- e | co |)] 

£-0 

Then, 

f(t) = lim | (j/2n) J exp [(s + jt) co] doo 
£ —► 0 i -oo 

00 

— (j/2n) J exp [( — e + jt)co~\ dco 



By virtue of the foregoing, the conjugate signal is connected to 
the original signal by a relation of the form 


The convolution of two 
signals is formed 


00 


5(t) = s(t) * (1/icr) = (l/7t) 



- 00 


(5.45) 


Alternatively, we may express the signal s(t) in terms of s(t) 
assumed to be known. To this end, it will suffice to note that the 
following relation exists between the spectra 

S (©) = j sgn (co) S (co) 


Therefore, the respective equation will differ from (5.45) only in 
sign: 


s(t) — - s(t)*(\/nt) = 


00 



— 00 


(5.46) 
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In mathematics, Eqs. (5.45) and (5.46) are known as the Hilbert 
transform pair. Symbolically, this is written as 

s(t) = H [s(t)] 

(5.47) 

s(t) = H~ 1 [s(0] 

Since the function 1 /(t — x), called the kernel of the Hilbert 
transform, has a discontinuity at x = t, the integrals in (5.45) and 
(5.46) should be understood in the sense of their principal value. 
For example, 


A 

Work Problems 15 
and 16 

• 

The principal value of 
an integral 


00 



Some properties of the Hilbert transforms. The simplest property 
of these integral transforms is their linearity: 

H ( t ) + a 2 s 2 (0] = a X H [s x (£)] + a 2 H [, s 2 (£)] 


at any values of the constants a x and a 2 , which can be verified by 
inspection. 

Since the kernel of the Hilbert transform is an odd function of 
x about the point x = £, the signal conjugate to the constant is 
identically equal to zero: 


00 


H [const] = — 
n 


const 

t—T 


dx = 0 


Another important property of the Hilbert transform is this: If 
for any t the original signal s(t) is a maximum or a minimum, then the 
conjugate signal crosses zero in the vicinity of that point. This can be 
verified by combining in the same drawing the plots of s(t) and of 
the kernel 1 f(t - x). Let t be close to that value of x at which s (t) is 
a maximum or a minimum. Then, owing to the fact that the signal 
shows even symmetry and the kernel shows odd symmetry the 
areas bounded by the horizontal axis and the curve representing the 
integrand function of the Hilbert transform cancel each other. 
Figuratively speaking, if the original signal varies in time as the 
cosine, the signal conjugate to it changes as the sine. 

It is to be noted that the Hilbert transforms are non-local: the 
behaviour of the conjugate signal in the vicinity of any point 
depends on the properties of the original signal along the entire 
time axis, although the largest contribution comes, of course, from 
the vicinity of the point in question. 

The Hilbert transform of a harmonic signal. For our subsequent 
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A 

Work Problem 17 


discussion it is important to know signals conjugate to simple 
harmonic waves of the form coscot and sin cot. The results can be 
derived by directly using Eq. (5.45). It is simpler, however, to 
proceed as follows. Let an arbitrary signal s(t) be defined by its 
Fourier transform: 



00 

S (co) (cos cot + j sin cot) dco 


— 00 


(5.48) 


On the basis of Eq. (5.44), the Fourier transform of the conjugate 
signal is: 



00 

—j sgn (co) S (co) (cos cot + j sin cot) dco 


— 00 


▲ 

Solve Problem 18 


1 

2n 


00 

sgn (co) S (co) (sin cof — j cos co t) dco 


(5.49) 


— 00 

From a comparison of Eq. (5.49) with Eq. (5.48), the following 
relationships can be stated for the Hilbert transform: 


H [cos cot] = sin cot sgn (co) 

(5.50) 


H [sin cot] = — cos cot sgn (co) 


The Hilbert transform of a narrowband signal. Let a narrowband 
signal s (t) be represented by its in-phase and quadrature amplitudes 
at some arbitrary reference frequency: 

s (t) = A s (t) cos a 0 t - B s (t) sin co 0 t (5.51) 

We will analyse the properties of the signal conjugate to s(t). To 
this end, we substitute Eq. (5.51) into Eq. (5.45), first having 
expanded the slowly varying functions A s (t) and ft(t) in a Taylor 
series about the point x = t: 


s(t) = - 
n 


dx 
t — x 


[A s (t) + A' s (t)(t — x) T ...] cos co 0 x 


1 


dx 


[ft (t) + ft (f)(t - x) + ...] sin co 0 x 


n 


— 00 


t — X 
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Since the derivatives A' s , ft, A" s , ft, etc. are negligibly small, we 
limit ourselves to the first terms of the expansions. Then 
approximately 

s(t) = A s (t)H [cos co 0 t] - ft (t)H [sin co 0 £] 

= A s (t) sin co 0 t + ft (t) cos co 0 r (5.52) 

Thus, in the case on hand the conjugate signal is likewise 
a narrowband wave. The last equality implies that if the complex 
envelope of the original signal is 


Us(t) = A s (t)+jB s (t) 
then for the conjugate signal 
= B s (t) — jA s (t) = — jU s (t) 

Thus, the complex envelope of the conjugate signal differs from 
that of the original signal by a constant phase shift of 90° lagging. 
The envelope, the total phase, and the instantaneous frequency. 

Under the Hilbert transformation, the envelope U s of an arbitrary 
signal s(t) is defined as a function representing time variations in 
the analytic signal: 


U s (t)= \z s (t)\ =]/s 2 (t) + s 2 (t) (5.53) 

The validity of this definition can be checked, using the envelope 
of a narrowband signal as an example. Here, on the basis of 
Eqs. (5.51) and (5.52) the envelope is defined by 

U s (t) = \/AUt) + BUt) 


The above equation has been developed earlier in Sec. 5.3 from 
other considerations. 

By definition, the total phase of any signal s(t) is equal to the 
entire argument of the analytic signal z s (t): 

\|/ s (t) = arg z 5 (t) = arc tan [s(t)/s (r)] (5.54) 

The instantaneous frequency co s (t) of the signal is the time 
derivative of the total phase: 


COs W = ~J7 arctan ~~7T 
d t s(t) 


s'(t)s(t)-s'(t)s(t) 


s 2 + s 2 


(5.55) 


Under the Hilbert 
transformation, the en¬ 
velope and the instan¬ 
taneous frequency are 
uniquely related to 
each other and may 
not be chosen arbitra¬ 
rily 


Consider several examples of how the above characteristics of 
various signals can be found. 

































156 


Part One. Signals 


Example 5.7. Let there be a simple harmonic wave 
s(t) = U 0 cos co 0 t 

Then the conjugate signal will be 
s(t) = U 0 sin co 0 t 

The envelope of the original signal 
U s =]/s 2 (t) + s 2 (f) = U 0 

does not, naturally, depend on time and is equal to its amplitude. 
The total phase of the signal is 

v|/ s (0 = <M 

and, finally, its instantaneous frequency is 


C0 S = C0 0 

This example shows that, by defining the envelope, total phase 
and instantaneous frequency of a signal in terms of Hilbert 
transforms, we obtain results which agree with our usual notions 
about the properties of harmonic waves. 

Example 5.8. The signal s(t) is the sum of two harmonic waves 
varying in amplitude and frequency : 

s(t)= U x cos©!* + U 2 cos © 2 1 


Since 

s(t) = U l sinco^-f U 2 sm(o 2 t 

then the envelope of the signal varies in time as 


17, (i) = \/U 2 1 + U 2 2 + 2U 1 U 2 COS (© 2 — CC ) x )t 

The total phase of the signal is 

, t/isin©i£ + U 2 sin © 2 £ 

(t) = arctan - 1 ----— 

U 1 COS CO 1 t+U 2 cos co 2 1 

The instantaneous frequency can be found by Eq. (5.35) which 
yields the following result: 


co s (0 = 


©! U\ + ©2 U\ + U 1 U 2 (©! + © 2 )cOS (©2 - ©i) t 
U\ + U\ + 2 U 1 U 2 cos (© 2 - ©i) t 


The variations in the instantaneous frequency with time are due 
to the fact that in this case the phase of the resultant phasor 
representing the sum of the two harmonic waves changes at 
a varying rate, according as the phasors of the components are 
oriented relative to each other. 

Example 5.9. Consider an ideal bandpass signal band-limited to the 
frequency interval [© l9 © 2 ]. 



The rate of phase 
change is low 



t/i 


The rate of phase 
change is high 
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The corresponding analytic signal takes the form 

0)2 

z s ( t ) = (S 0 /n) J exp(/©£)d© = (S 0 /nt) [(sin © 2 £ — sin c t ) 

0)1 

—j (cos © 2 £ — COS ©iO] 

The envelope of the original bandpass signal is 
U s (t) = (S 0 /nt)]/(sm (o 2 t — sm(o 1 1) 2 + (cos (o 2 t - cos co 1 1) 2 


SoLtOj-CBi) 

. © 2 — © t 
sm ——-t 
2 

71 

C0 2 —©J 


Finally, the instanteneous frequency of the signal is 

d f — (cos© 2 t —cos©! t) 

© s = i arctan-;-:- 

dt |_ sm© 2 t-sm© 1 t 

After simple manipulations, we find in accordance with Eq. (5.38) 
that the instantaneous frequency 

©s = (©i + © 2 )/2 

is independent of time in our case and is equal to the centre fre¬ 
quency of the interval within which the spectrum is concentrated. 


To sum up, the concept of the analytic signal enables us to 
define the envelope and the instantaneous frequency of narrowband 
signals without resort to* the somewhat artificial concept of the 
reference frequency typical of the complex-envelope method. 
Moreover, Eqs. (5.53) through (5.55) remain in force when applied 
to arbitrary signals not necessarily quasiharmonic (narrowband). 
However, we cannot of course require that the envelope and the 
instantaneous frequency possess a simple and easy-to-grasp physical 
meaning. 

Closing remarks The theory of the analytic signal, as applied to 
the theory of oscillations and waves, was developed by Gabor [17] 
in the 1940s. However, the Hilbert transforms had appeared in 
mathematics much earlier as a technique for solving the so-called 
boundary problem in the theory of analytic functions [10]. The 
rationale of the problem is as follows. 

Let C = § +/n be a complex variable, and f(Q be a complex 
analytic function in the upper half-plane, that is, for r\ > 0. On the 
real axis which is the boundary of the analyticity region, the 
function /(£) has both a real and an imaginary part: 
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It is required to establish the relation that connects the functions 
/i (£) and f 2 (£). The solution to the problem is given by a Hilbert 
transform pair: 

It can be shown that the analytic signal z s (t) does possess the 
property of analyticity in the upper half-plane, if it is regarded as 
a function of a complex variable, t = t + jt". It is this property that 
explains the origin of the term “analytic”. 

In recent years, the analytic-signal methods and the Hilbert 
transforms have taken up a strong position as techniques of 
communication theory. Some of the most interesting problems in 
this field are covered in [24]. 


Summary 

OO* Band-limited signals extend without bound in time. 

<X> The simplest signals in this class, the ideal low-pass signal and the ideal bandpass 
signal, appear at the output of the corresponding ideal filters excited by a delta 
impulse. 

30 Two ideal low-pass signals can be made orthogonal through the proper choice of the 
time shift between them. 

0^ The Kotelnikov series is a generalized Fourier series which yields the expansion of the 
signal in terms of basis functions band-limited to a certain highest frequency / u . Here, 
the basis functions are ideal low-pass signals shifted in time relative to one another by 
an interval 1/(2 \f u ). 

<00 The coefficients of the Kotelnikov series are the samples of the signal being expanded, 
taken at equal time intervals. 

If the signal spectrum has no components at frequencies higher than / u , the 
Kotelnikov series gives an exact (in the mean-square sense) representation of the 
signal. 

The bandwidth of a narrowband signal must be a small fraction of the centre fre¬ 
quency. Narrowband signals are quasiharmonic; in the general case, their amplitude 
and frequency slowly vary in time. 

The concept of the complex envelope is a generalization of the concept of the complex 
amplitude to narrowband signals. 

<0^ The physical envelope is equal to the magnitude of the complex envelope. Its form 
does not depend on the choice of the reference frequency. 

Ov> The instantaneous frequency of a narrowband signal is the sum of the reference fre¬ 
quency and the time derivative of the argument of the complex envelope. 
*0^ The spectrum of a narrowband signal can be derived from that of its complex 
envelope by translating it by the magnitude of the reference frequency. 

To any real signal we can assign a complex analytic signal containing solely positive- 
frequency spectral components. 
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00 The real part of an analytic signal is equal to the original signal. The imaginary part 
is called the conjugate signal. 

00 The relation between the original signal and its conjugate signal is established by 
a Hilbert transform pair. 

OO The envelope of an arbitrary signal is equal to the magnitude of the corresponding 
analytic signal. The instantaneous frequency is defined as a derivative of the argument 
of the analytic signal. 

Review Questions 

1. Why is it that band-limited signals are suitable mathematical models to represent the 
real waves observed in communication circuits? 

2. Draw approximate waveforms of the ideal low-pass signal and the ideal bandpass signal. 

3. How can it be explained that an increase in the upper frequency limit is accompanied by 
a rise in the extremal values of the ideal low-pass signal and of its derivative? 

4. Draw plots of several functions belonging to the Kotelnikov basis. Name their typical 
properties. 

5. Write the formula of the Kotelnikov series and state in words the Kotelnikov theorem. 

6. Draw a plot for the case when samples are not taken frequently enough for the 
Kotelnikov series to represent a signal faithfully. 

7. What controls the magnitude of the error in the signal representation by the Kotelnikov 
series? 

8. What is the graphical meaning of the dimensionality of the band- and duration-limited 
signal space? 

9. Draw a typical waveform for a narrowband signal. 

10. Explain how the in-phase and quadrature amplitudes of a narrowband signal can be 
determined experimentally. 

11. Formulate the properties of the physical envelope of a narrowband signal. 

12. Explain how the concept of the analytic signal can be introduced. 

13. How are the spectra of the original and conjugate signals related? 

14. Name the basic properties of the Hilbert transform. 

15. Explain how one can take the Hilbert transform of a narrowband signal. 

16. Why is it that the analytic-signal method is more general than the complex-envelope 
method? 
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Problems 

1. An ideal low-pass signal has a 
spectrum whose magnitude is 5.5 x 10" 4 
V s in the frequency band from zero to 
25 kHz. Find the maximum instantaneous 
value of the signal. 



2. Measurements have shown that an 
ideal bandpass signal has the following 
parameters: 0 = 20 ps and U 0 = 15 V. Find 
the bandwidth of the signal and the mag¬ 
nitude of its spectrum within the band¬ 
width. 

3. Evaluate the maximum value of the 
derivative of the ideal low-pass signal defi¬ 
ned in Problem 1. 

4. An automatic weather station transmits 
weather data at two-hour intervals. What is 
the highest frequency in the spectrum of the 
transmitted signal? 

5. The spectrum F(cd) of a band-limited 
signal v(t) is triangular in shape: 



Determine the Kotelnikov coefficients for the 
signal, assuming that samples are taken at 
time intervals equal to 7t/oo u . 

6. A band-limited signal is exactly 
represented by two non-zero samples: 


6 

v, V 


r 

3 

i i 



i L|is 


I I _|_L 

-4-202468 


What is the highest frequency in the 
spectrum of the signal? Find the in¬ 
stantaneous value of the signal at t= 17 ps. 

7. How will the approximation error for 
the signal in Example 5.3 increase, if the 
sampling rate is increased ten-fold? 

8. A signal s(t) is harmonic both at t>0 
and t< 0; at t = 0 its phase is reversed: 



Write an expression for the complex 
envelope of the signal. 

9. Derive an expression for the complex 
envelope of a truncated voltage sinewave: 



Note the initial phase of the signal. 

10. Determine the complex envelope of 
a single-tone angle-modulated signal: 

u(t) = l/ 0 cos(co 0 t + msin £lt) 

11. Write an expression for the complex 
envelope of an LFM signal (see Chap. 4). 

12. A narrowband signal in the 
neighbourhood of the reference frequency co 0 
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has a Gaussian spectrum 

S( cd) = (S 0 /2)exp [~b{ co - oo 0 ) 2 ] 

Determine the spectrum of the complex 
envelope of the signal. Find how the 
physical envelope changes in time. Calculate 
the instantaneous frequency of the signal. 

Compare the results with those stated in 
Example 5.5. How do you explain the fun¬ 
damental difference between them? 

13. Find the analytic signals correspond¬ 
ing to simple harmonic waves sinco 0 t and 
cos co 0 t. 

14. Find the analytic signal corresponding 
to an r.f. pulse which has a rectangular 
envelope 

u ( t ) = U 0 [a ( t ) - a (t - T p )] cos co 0 t 

15. Determine the signal conjugate to 
a harmonic wave cosco 0 t by directly using 
the Hilbert transform as given in (5.45). 

16. Solve a problem similar to that stated 
in the previous case, for a signal 

s(t) = sin (o 0 t/co 0 t 

17. Find the signal conjugate to 
a periodic wave specified by its Fourier 
series: 

00 

s(t)= X ^/(CosCfaOit-cpk). 
k=0 

18. Show that the in-phase and quadra¬ 
ture amplitudes of a narrowband signal s(t) 
are connected to the components of the 
analytic signal by relations of the form: 

A s (t) = s (t) cos co 0 £ + s(t) sin co 0 t 
B s (t) = s(t) cos co 0 t — s(f)sin co 0 t 

Advanced Problems 

19. Prove the Kotelnikov theorem in the 
frequency representation, which is stated 
thus: If a signal s(t) is identically equal to 
zero outside the interval t x < t < t 2 , then its 
spectrum S(co) is uniquely defined by the 
sequence of values at points spaced 1 /(r 2 — 

— G) Hz apart on the frequency axis. 


20. Generalize the Kotelnikov theorem to 
the case of band-pass signals whose 
spectrum occupies a frequency band (o 1 < 
< co < co 2 . Find analytic expressions for the 
basis functions of these signals. 

21. Let there be a narrowband signal 

s ( t) = A s (0cos co 0 1 - B s ( t ) sin co 0 t 

Analyse the constraints that must be 
imposed on the slowly varying functions 
A s (t) and B s (t) in order that the instan¬ 
taneous frequency be constant in time. 

22. Determine and analyse the envelope, 
the total phase, and the instantaneous fre¬ 
quency of the ideal low-pass signal defined 
in Example 5.6. 

23. Find the analytic signal for a wave, 
whose spectrum has a regular part and 
a component with a delta singularity. 



24. Using the analytic-signal method, 
analyse the envelope and instantaneous fre¬ 
quency of a single-tone SSB signal. 

25. Using the generalized Rayleigh for¬ 
mula, prove that if s(t) is a finite-energy 
signal, the signal conjugate under the 
Hibert transform, s(t), is orthogonal to it. 

26. Prove that the signals s(t) and s(t) 
have the same energy and the same 
autocorrelation function. 

27. Show that for a rectangular video 
pulse 


f U 0 , — ip /2 < t < ip /2 

j 0, \t\ > Xp /2 


the conjugate signal is 


u(t) = —In 
n 


Xp + 2 1 
Xp — 2 1 


6-728 




























































Chapter 6 


An Outline of the Theory 
of Random Signals 

In radio communication systems, random signals most often 
occur as noise. These electromagnetic waves chaotically varying in 
time are produced in various physical structures when a charge 
carrier, say an electron, is in random motion. 

In information theory, the mathematical model of a random 
signal is used for the probabilistic representation of the relations 
existing in messages having the form of meaningful texts in some 
language. 

In present-day laser communication links, the signals are likewise 
random. The relatively high energy of a quantum of the 
electromagnetic field (a photon) makes it fundamentally necessary 
to consider the specific quantum noise which manifests itself in the 
reception of weak optical signals. 


6.1 Random Variables and Their Characteristics 


Fluctuations 



Large deviations are 
rare 


In this section we shall recapitulate the most important concepts 
from probability theory, essential in tackling the problems of 
statistical communication theory. A more detailed exposition of the 
matter can be found in [3] and [15]. 

Probabilistic laws. A distinction of a random signal is that we 
cannot predict and calculate its instantaneous values in advance. 
From an analysis of such signals, however, we may conclude that 
some of its properties can be defined with sufficient accuracy in the 
probabilistic sense. For example, the voltage across the terminals of 
a noisy circuit element consists of some average level and fast 
time-varying random variations called fluctuations. These fluc¬ 
tuations are such that most frequently we observe relatively small 
variations from the average level; the larger the absolute magnitude 
of the variations, the more seldom they occur. Already this is 
a statistical pattern. If we know the probabilities of fluctuations of 
various magnitude, we can develop a mathematical model for the 
random wave involved, quite acceptable in both the theoretical and 
the applied sense. 

Probabilistic laws manifest themselves whenever a physical 
system generating a random signal is an assemblage of a very large 
number of smaller subsystems executing some motions more or less 
independent of one another. For example, the current caused to 
flow around a circuit by a constant-emf source owes its constancy 
(well known from practice) to the fact that in order to produce 
a current of, say, 1.6 mA, a huge number of electrons (of the order 
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of 10 16 ) must pass through the cross section of the conductor every 
second. Obviously the random fluctuations in velocity between the 
individual electrons can have but a negligible effect on the average 
current. 

Probability. Present-day probability theory is an axiomatized 
branch of mathematics which has pooled a wealth of material 
amassed by science in the study of widely varying random 
processes. 

The basis of this theory is the concept of the general population 
of “elementary outcomes” or random events 

Q = {Ai, A 2 ,A n , ...} 

The symbols Aj represent the likely outcomes of some random 
experiment. To each event A/eQ is assigned a real number P{Ai) 
which is called the probability of that event. 

The following axioms are accepted: 

1. The probability is non-negative and does not exceed unity: 
O^P(Ai)^ 1 

2. The union of all events belonging to Q is a certain event 


3. If A is some complex event, its probability is equal to the sum 
of all the elementary probabilities: 


The electronic charge 
is = 1.6 x 10” 19 C 


The probability axi¬ 
oms were formulated 
by A. N. Kolmogorov 
in the 1930s 


p(A)= y p(Ai) 

A^A 

Measurement of probabilities. The mathematical concept of the 
probability of a random event is an abstract characterization 
associated not with the material objects of interest, but with their 
set-theoretic models. Some additional agreement is in order so that 
we can extract information about the probabilities from 
experimental data. 

It is customary to evaluate the probability of an event in terms of 
the relative frequency of favourable outcomes. If we have carried 
out N independent trials and have observed an event A in n of 
them, then the empirical (or sample) estimate of the probability P(A) 
that can be derived from this series of trials is 


Ps(A) = n/N 


( 6 . 1 ) 


Example 6.1. The output signal from an electronic device can take 
on only any one of two values: v 1 = 4.5 V (“ HIGH ”, event AJ and 
v 2 = 0.5Y (‘‘LOW-, event A 2 ). The system can change state in 
a random manner at equal time intervals T. The experiment consists 


6 * 
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in repeatedly measuring the instantaneous value of the output signal 
The instants at which the measurements are made are arbitrary, but 
they are spaced apart substantially more than T. 

Suppose that the experimenter has carried out 100 independent 
trials during which the event A x occurred 43 times and the event 
A 2 , 57 times. In accordance with (6.1), the sample estimates of the 
two probabilities are 

P s (^i) = 0.43 

and 

P s (A 2 ) = 0.57 

From these data it does not at all follow that the theoretical 
(general-population) probabilities must be like that. Rather, the 
experimenter will advance the hypothesis that the two events are 
equiprobable: 

P(A l ) = P(A 2 ) = 0.5 

If, however, the same sample estimates are obtained in a series of 
10000 trials, the hypothesis must apparently be rejected. 




▲ 

Solve Problem 1 


The distribution function and the probability density. Let X be 
a random variable, that is, all possible real numbers x which take 
on random values in the interval - oo <x < + oo. The statistical 
properties of X can be described exhaustively if we have at our 
disposal a nonrandom function, F(x), of the real argument x, which 
is equal to the probability that X will take any one of the allowed 
values x or less on any given trial of the experiment: 


F(x) = P(X^x) 


The function F(x) is called the distribution function of the random 
variable X. If X can take on any value, then F(x) is a smooth, 
nondiminishing function whose values lie in the interval 0 ^ F (x) ^ 
<1. The following limiting equalities exist: F(-oo) = 0 and 
F(oo) = 1. 

The derivative of the distribution function 
p (x) = dF/dx 

is the probability density of the random variable in question. 
It is obvious that 


p (x)dx = P{x < X ^ x + dx) 
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that is, the term p(x)dx is the probability of the random variable 
X falling within the interval (x, x + dx). 

For a continuous random variable X the probability density p(x) 
is a smooth function. If, on the other hand, A is a discrete random 
variable which can take on fixed values {x x , x 2 , ..., x m , ...} with 
probabilities {P t , P 2 ,..., P m , ...} respectively, then 

p(x) = £P,5(x-x,) 

i 

In either case, the probability density must satisfy the condition 
of nonnegativity 

p(x)^ 0 

and the condition of normality 

00 

{ p(x)dx=l 

— 00 

Averaging. Moments of a random variable. Experiments fre¬ 
quently yield the averages of a function of the random variable. If 
cp(x) is a specified function of x (an outcome of a random trial), 
then, by definition, its average is 


(p (x) = J cp(x)p(x)dx (6.2) 


From Eq. (6.2) it follows that the largest contribution to the 
average value comes from those values of x for which both the 
function being averaged, cp1(x), and the probability density p(x) are 
simultaneously large. 

Any statistical theory uses special numerical characteristics for 
random variables, called their moments. The nth-order moment of 
a random variable X is the nth-order average value of the random 
variable 

00 

x n = J x n p{x)dx (6.3) 

— 00 

The first moment, which is the simplest moment of all, is the 
expected value (expectation or mean) of the random variable X: 

00 

m 1 =x= j xp(x)dx (6.4) 

— 00 

This is an estimate for the average of a random variable, obtained 
from a sufficiently large series of trials. 

The second moment of a random variable is the mean square 


A 

Work Problem 2 


The overscribed bar 
implies that the aver¬ 
age value of the quanti¬ 
ty under the bar is 
taken 


Moments of a random 
variable 


Expectation generali¬ 
zes the concept of the 
arithmetic mean in the 
probabilistic sense 
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Variance 


▲ 

Standard deviation 


Solve Problems 3 and 4 


The uniform distribu¬ 
tion is often used in 
error theory 


value of that random variable: 

m 2 = x 2 = J x 2 p(x)dx (6.5) 

— 00 

Probability theory also uses the central moments of random 
variables, which are defined as 


p„ = (x-x")”= j (. x-x) n p(x)dx (6.6) 

— 00 

The most important central moment is the variance of a random 
variable, defined by 

o$ = H 2 = (x- x ) 2 ( 6 - 7 ) 

It is obvious that 

cr 2 = (x 2 - 2xx + 3c 2 ) = x 2 - x 2 ( 6 - 8 ) 

The quantity cs x , that is, the square root of the variance, is called 
the standard deviation of the random variable X. It is a measure for 
the spread of the results from individual random trials about the 
sample mean. 

The uniform distribution. Let there be a random variable 
X which can take on values only from the interval x 2 < x < x 2 , 
such that they have an equal probability of falling within any inner 
subintervals of the same width Ax. Then, obviously, the probability 
density will be 


f o, 

P(x)=< l/(X 2 -*i)> 

l °’ 


X < x x 
x x ^x^x 2 
X > x 2 


The distribution function is found by 


f(x)= j P mi= 


— 00 


0, 

(x-x 1 )/(x 2 -x 1 ), 

1, 


integration 
x < x x 
X^ ^ X ^ x 2 
X > x 2 


The expectation (or mean) 


1 X 2 

x =-f xdx = 

*2-*l *1 


(*2~*i) 

2 


occurs, naturally, at the centre of the interval (x x , x 2 ). 

As can readily be verified, the variance of a random variable 
under the uniform distribution is 


Ox = (x 2 ~ x^/U 

The Gaussian (normal) distribution. In the theory of random 
signals, a fundamental part is played by the Gaussian probability 
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density 


P M = TZr- ex P [ - (* ~ m) 2 /2cr 2 ] (6.9) 

y 2tuct 

defined by two numerical parameters, m and a. The corresponding 
plot is a bell-shaped curve with a single maximum at the point x = 
= m (Fig. 6.1). 


P 



Note that as a dec¬ 
reases, the plot loca¬ 
lizes more and more 

at x = m 


Fig. 6.1 Plot of the Gaussian probability density for several values of a 


It can be verified by direct calculation that the parameters of the 
Gaussian distribution have, respectively, the meaning of the 
expectation (mean) and the variance of a random variable: 

x = m 


The distribution function of a Gaussian random variable is 

F(x) = (l/j/27tcj) J exp [ — (| — m) 2 / 2 ( 7 2 ] d£, 

— 00 

By a change of variable, r = (^-m)/a, it reduces to the form 

_ (x — m)/cr 

F(x) = (l/]/2jt) J exp( - t 2 /2)dt 


= O [(x — m)/a] 


( 6 . 10 ) 


where the probability integral [40] is defined by 


O (x) = (1 / j/2tt) j* exp (— t 2 / 2) dt 


The plot of the function (Fig. 6.2) is a monotonic curve varying 
from zero to unity. 

The probability density of a function of a random variable. Let Y 
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Fig. 6.2 Plot of the distribution function for a Gaussian random variable 

be a random variable connected to X by a unique functional 
relation of the form y=f(x). The occurrence of a random point 
x within an interval of width dx and the occurrence of a random 
point y in the corresponding interval of width |dy| = |/(x)|dx are 
equiprobable events such that 

p x (x)dx = \p y (y)dy\ 


Hence, 

Py(y) = Px (x) |dx/d>’| = Px[g(yi] \dg/dy\ (6.11) 

where g(y) = x is the inverse of/(x) = y. 

If the functional relation between X and Y is not unique and 
there are several inverse functions 



Xi=gi(y) 

x 2 = 02 (y) 

xn = 0jv (y) 

then Eq. (6.11) is generalized in the following manner: 


N 


Py(y)= Z P(xi) |dxj/dy| 

i= 1 


( 6 . 12 ) 


Example 6.2. Linear transformation of a Gaussian random variable. 
Let 

Y= aX + b 


and the probability density 

Px(x) = (1/|/27cct) exp [ - (x - m) 2 / 2a 2 ] 

Since 

\dx/dy\ = l/\a\ 
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then, on the basis of Eq. (6.11), 

p y (y) = (l/|/27ca|a|) exp [ - (y - b - ma) 2 /2a 2 cr 2 ] 

Thus, the random variable retains its Gaussian behaviour under 
linear transformation. The variable derived by this transformation 
has the mean 

y = b-\-ma 

A and the variance 

Solve Problem 7 

c jy = a z oi 


The characteristic function. An average of particular importance 
to probability theory is one of the form 


00 

@(r) = exp (jvx) = J p(x)exp(jvx)dx (6.13) 

— 00 


called the characteristic function of the random variable X. To 
within the constant coefficient, the function 0(i?) is the Fourier 
transform of the probability density, so 

1 00 

p(x) = — f 0(y) Qxp(—jvx)dv (6.14) 

2^ _ go 

It is clear that one and the same random variable can be equally 
well described by its characteristic function and by its probability 
density function. The choice is a matter of mathematical 
convenience. 

Omitting elementary manipulations, here are some results: 
- for a random variable with a uniform distribution over the 
interval 0 < x ^ a, 

0(f) = [exp (jav) - 1 ~\/jav (6.15) 

- for a Gaussian random variable with specified parameters 
m and a, 

0(f) = exp(/mf — a 2 f 2 /2) (6.16) 

The characteristic function offers a simple means for 
determining the moments of random variables. To demonstrate, 

00 

d"@ (v)/dv n = f J x”p(x)exp(/yx)dx 

— 00 

On setting f = 0 and equating to (6.3), we get 

m„=r"0 W (0) 


(6.17) 
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F 



0.75 



Near the origin the 
curve has a linear 

0.5 



portion 

^0.25 


x-m 


, i-1- 

i i i 

6 


-2.0-1.5 -1.0 -0.5 0 0.5 1.0 1.5 


Fig. 6.2 Plot of the distribution function for a Gaussian random variable 

be a random variable connected to X by a unique functional 
relation of the form y=/(x). The occurrence of a random point 
x within an interval of width dx and the occurrence of a random 
point y in the corresponding interval of width \dy\ = \f(x)\dx are 
equiprobable events such that 

Px{x)dx = \py(y)dy\ 


Hence, 

Py(y) = Px(x)\dx/dy\ = p x [<?(>’)] \dg/dy\ (6.11) 

where g(y) = x is the inverse of f(x) = y. 

If the functional relation between X and Y is not unique and 
there are several inverse functions 



*1 = 0i 00 

x 2 = g 2 (y ) 

XN = gN(y ) 

then Eq. (6.11) is generalized in the following manner: 

iv 

Py(y) = X p(xi)\dxi/dy\ 


( 6 . 12 ) 


Example 6.2. Linear transformation of a Gaussian random variable. 
Let 

Y=aX + b 


and the probability density 

p x (x) = (l/|/27 ict) exp [ - (x - m) 2 /2cr 2 ] 

Since 

|dx/dy| = l/|a| 
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then, on the basis of Eq. (6.11), 

Py(y) = (l/|/27ccj|a|) exp [ - (y - b - ma) 2 /2fl 2 cr 2 ] 

Thus, the random variable retains its Gaussian behaviour under 
linear transformation. The variable derived by this transformation 
has the mean 


A 

Solve Problem 7 


The characteristic function. An average of particular importance 
to probability theory is one of the form 


y = b + ma 
and the variance 

Gy = a 2 Gx 


OO 

0( v ) = exp (jvx) = j p{x) exp (jvx) dx (6.13) 

— OO 


called the characteristic function of the random variable X. To 
within the constant coefficient, the function 0(i?) is the Fourier 
transform of the probability density, so 

1 00 

p(x) = —— f 0(i;)exp( —jvx)dv (6.14) 

-oo 

It is clear that one and the same random variable can be equally 
well described by its characteristic function and by its probability 
density function. The choice is a matter of mathematical 
convenience. 

Omitting elementary manipulations, here are some results: 
- for a random variable with a uniform distribution over the 
interval 0 ^ x < a, 

0 ( v ) = [exp (jav) - 1 ~\/jav (6.15) 

- for a Gaussian random variable with specified parameters 
m and a, 

0(v) = exp (jmv — g 2 v 2 / 2) (6.16) 

The characteristic function offers a simple means for 
determining the moments of random variables. To demonstrate, 

oo 

d n S(v)/dv n =j n J x n p(x)exp(/i;x)dx 

— 00 

On setting i; = 0 and equating to (6.3), we get 

m „=;-"© ( ">(0) 


(6.17) 
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A 

Work Problem 6 


Using the characteristic functions, it is convenient to find the 
probability densities of random variables that have been subjected 
to functional transformations. Thus, if 

y=f(x) 

then 

Q y (v) = exp (jvy) = exp (>/(x)] 

The problem on hand will be solved, if we are able to evaluate the 
Fourier transform in (6.14). 


Example 6.3. Let y=U 0 cos x, where U 0 is constant, whereas x is 
the value of a random variable uniformly distributed over the interval 
— K^x^n. 

Since 

Px(x) = l/2n 
then 

n 

® y (v) = (1 /2n) J exp (jvU 0 cos x) dx = J 0 (vU 0 ) 

— U 


where J 0 is the Bessel function of first kind, of order zero. Using 
the tabulated integral [40], we get 


Py(y)=fr I J 0 (vU 0 )exp(jvy)dv= \ — 1 • • I VI < Up 

271 - l 

o, \y\>u 0 

From the shape of the probability density plot it is seen that if 
we carry out a large series of trials, with the value of x taken each 
time at random from the specified interval, the term U 0 cosx will 
most often assume values close to ±U 0 . 



6.2 Statistical Characteristics of Two and More 
Random Variables 

As is customary, the properties of a random signal process are 
analysed from the collection of values observed at different fixed 
instants, rather than at one particular time. What follows is a brief 
outline of the theory of such multivariate or vector systems. 

The distribution function and the probability density. Let there 
be random variables {X l9 X l9 ..., X n } which form an n-dimensional 
(or vector) random variable X. By analogy with the one- 
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dimensional case, the distribution function of this vector variable 
may be defined as 

F(Xi, X 2 , •••, Xn) = P(X i ^ Xi, X2 ^ X 2 , Xn Xn) 

The corresponding rc-dimensional (or nth-order multivariate) 
probability density p(x l9 x 2 , ..., x n ) satisfies the relation 


p(x l9 x 2 ,..., x n )dx 1 dx 2 ...dx n 

P {Xi X i ^ X j. ~h dXj ,..., Xn < C Xn ^ Xn dx^| 

Obviously, the distribution function can be evaluated by 
integrating the probability density function: 

*1 

F(x 1 ,x 2 ,...,x„)= J I p(^,..,yd^...d^ 

— oo — OO 

Any multivariate density has the usual properties of a univariate 
probability density 

00 00 

p(£l 9 ••• 5 ^n) ^ 0; J ... J pd^ 1 ...d^n=l 

— 00 — 00 

If we know the n-dimensional density, we can always find the 
m-dimensional density for m < n by integrating over the “redun¬ 
dant” coordinates: 


P(^l > •••> ^m) — J ... J p(^i,..., ..., ^n)d^ m+ ! ...d^ w 

— 00 — 00 

Moments. If we know the corresponding multivariate probability 
density, we can find the various averages of any combinations of 
the random variables involved, and, notably, their moments. For 
example, limiting ourselves to the two-dimensional case as most 
important for our further discussion, we find by analogy with (6.4) 
and (6.7) the expectations (or means) 


00 

*1 = II x 1 p(x 1 ,x 2 )dx 1 dx 2 

— 00 
00 

^ 2 = II X 2 p{x 1 ,x 2 )dx 1 dx 2 

— 00 


(6.18) 


and the variances: 

00 

a i = II C*i - *i) 2 P(*i ,x 2 )dx 1 dx 2 

-oo 

00 

ct 2 = II (x 2 -x 2 ) 2 p(x 1 ,x 2 )dx 1 dx 2 

1 85 bsmo 


(6.19) 


— 00 
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$ 

The covariance mo¬ 
ment 


What is new in comparison with the one-dimensional case is that 
we can form a second-order joint moment called the covariance 
moment* of a two-dimensional random variable: 

OO 

k 12 = x 1 x 2 = JJ x 1 x 2 p(x 1 ,x 2 )dx 1 dx 2 (6.20) 

— 00 



m 

The correlation mo¬ 
ment 


Correlation. Suppose that we have carried out a series of trials 
each of which has yielded a two-dimensional random variable 
{x 1 ,x 2 }. Let us agree to represent the outcome of each trial by 
a point on a Cartesian plane. 

It may so happen that on the average the representative points 
fall on a straight line, which means that on any one trial the values 
and x 2 have the same sign. This suggests the existence of 
a statistical association between x x and x 2 l called correlation. 

On the other hand, it may so happen that the points lie in 
a chaotic fashion on the plane. Now the values are said to be 
uncorrelated, that is, there is no consistent statistical association 
between them. 

Quantitatively, the degree of statistical association between two 
random variables is stated in terms of their covariance moment k 12 
or, which is often more convenient, in terms of their correlation 
moment K 12 ** defined as the mean of the product (x 1 —x 1 )(x 2 — 
-x 2 ): 

00 

K i 2 = II (x 1 -x 1 )(x 2 -x 2 )p(x 1 ,x 2 )dx 1 dx 2 


= k 12 -x 1 x 2 (6.21) 

We also introduce a dimensionless correlation coefficient 
^12 = ^12/ CT 1 CT 2 (6.22) 


When the two random variables are the same, that is, x 1 =x 2 , 

K u = K 22 = ° 2 and R 11 = R 2 2 = 1 

If a random vector variable has a dimension of more than two, 
we may form the respective cross-correlation moments 

00 00 

K ij= | - J (Xi-x i )(xj-xj)p(x 1 ,...,x„)dx 1 ...dx n 
— 00 — 00 

i, 7 = 1 , 2, n. 


* Other authors [16] call it correlation-Translator’s note. 

** This is frequently termed covariance. See [16, 20].- Translator's note. 
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and the respective correlation coefficients 

Rij = Kij/GiOj 

which can be combined into the corresponding matrices 


pc 11 ■ • 

■ • • kD 


T - 

Rl2‘ 

■ • R\n 

k 21 . . 

. . . K 2n 

and R = 

R 21 

1 ... 

^2 n 

K n i . • 

• • • K nn 


Rni • 

1 



It can be shown that \Ry\ ^ 1 always, and the equality holds only 
when x 1 = ± xj (completely correlated variables). 

Statistical independence of random variables. By definition, the 
random variables X l9 X 2 , ..., X n are statistically independent if 
their multivariate probability density can be represented as the 
product of the corresponding univariate densities: 


p(x 1 ,x 2 ,...,x n ) = p{x 1 )p (x 2 )... p (x n ) 


(6 23) Statistical indepen¬ 
dence 


Statistically independent random variables are pairwise 

uncorrelated. To demonstrate, for 

00 00 

Kij = J (Xi-Xi)p(xi)dxi J (xj — ~xj) p (xj)dxj = 0 

- 00 - 00 

The converse is not true in general: If random variables are Work Problem 12 
uncorrelated, this does not mean automatically that they are 
statistically independent.* 

Functional transformations of multidimensional random 
variables. Let two random vector variables X and Y be related uni¬ 
quely by the following relation: 


Ti =/i (*!,...,*«) 


yn —fn(x 1 , Xn) 


for which we know the inverse functions 

= 9i(yi,-,yn) 


Xn — Qn(y\ > •••j yn) 

The original probability density porig(x 1 ,...,x n ) is specified in 
advance. So that we could generalize Eq. (6.11) to a multi¬ 
dimensional case and evaluate the probability density of the 
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The Jacobian is a 
coefficient of propor¬ 
tionality between ele¬ 
mentary volumes in a 
functional transforma¬ 
tion 


transformed vector variable, ptransOh, y n \ we should use the 
Jacobian of the transformation: 


D = 


8di 

Sgi 

8g 


dy 2 

dy, 

8g n 

dg n 

8g, 

dy i 

dy 2 

dy, 


(6.24) 


Then the sought probability function takes the form 


PtransOh ? —jjn) — Porigfeh > —>0n) \D\ 


(6.25) 


Example 6.4. Let x 1 and x 2 be the random coordinates of the 
vector tip on a plane. 

If we change to the polar coordinates (p, cp), 
x y = p cos cp f 0 ^ p < oo 

x 2 = p sin (p | 0 ^ cp < 271 


then the Jacobian of the above transformation will be 
cos cp — p sin cp 


D = 


sm cp 


p cos cp 


So, if the specified probability density is p Q rig(x l9 x 2 ), then 
Ptrans(p, Cp) = pp 0 rig(p COS Cp, p sin Cp) 



The multivariate Gaussian distribution. Suppose that for an 
rc-dimensional (vector) random variable, X = {X l9 ...,X n } 9 we know 
the means (m 1 ,...,m„), the variances (a^,...,a^), and the correlation 
coefficient matrix R. 

In the general case, this information is not a sufficient basis on 
which to form the n-dimensional probability density. The only 
exception is the case where I is a multidimensional Gaussian 
variable. Then, by definition, 


1 


2n) n,2 D 112 

Xi — mi Xj 


P(x 

, x n ) — 



( 1 ” 

j 

x exp 




(6.26) 


where D is the determinant of the matrix R, and D t j is the cofactor 
of the element Rij in that matrix. 
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Let the vector variable X be formed by uncorrelated random 
variables such that in the matrix R only the elements on the 
principal diagonal are non-zero: R t j = 5 jj. Then D = 1 and D t j = 5y. 
On substituting them in (6.26), we have 


p(xx n ) 


(2ti)" /2 ct 1 ... ct„ exp 


1 £ (xj — ntj) 2 ~j 

^ i = 1 CTj J 


= p(x 1 )p(x 2 )...p(x n ) 

where each of the univariate Gaussian distributions has the mean 
mt and the standard deviation a;. Hence we may state an important 
property of the Gaussian distribution: If a Gaussian set is formed by 
uncorrelated random variables, they are all statistically independent. 

In our further discussion we shall frequently use the bivariate 
Gaussian probability density 


i,x 2 ) = 


2'K<3 1 <3 2 \/\ — R : 


-exp 


1 


2(1 — R 2 ) 


(*i - m i) 2 


_ 2R (*i -mi)(x 2 -m 2 ) | (x 2 - m 2 ) 2 


a l a 2 


G 2 2 


(6.27) 


The Kronecker delta 


8;,- 


1, i=j 
0, i # j 


A 

Solve Problem 10 


where R = R 12 = R 21 is the correlation coefficient between x x and 
x 2 . The above expression is simplified if m 1 =m 2 = 0 and a x = 



absolute maximum at the origin. The configuration of the surface is 
decided by the correlation coefficient R. 

The multidimensional characteristic function. A generalization of 
the characteristic function to the multidimensional case is the 
n-dimensional Fourier transform of the corresponding probability 
density: 


&(v 1 ,v 2 ,—, v„) = exp \J(x l v 1 +x 2 v 2 +... + x„y„)] 

00 00 

= j ... | expQ'txji;! +... + X n Vn)] 

— oo — 00 


X p(x 1 ,...,x n )dXj ...dx. 


(6.29) 
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The multidimensional characteristic function defines a system of 
random variables to the same degree of completeness as does the 
inverse Fourier transform of the corresponding probability density: 

| 00 CO 

p(x 1 ,...,Xn) = -^TTn j - J ©Oh, •», Vn) 

— oo — oo 

x exp [ —j(x ii?! +... + x n v „)]dtq ...du M (6.30) 

If {XX„} are statistically independent, then, by virtue of Eq. 

(6.29) , the multidimensional characteristic function factors into the 
one-dimensional characteristic functions associated with the indivi¬ 
dual random variables: 

n 

0(ih,...,i>«)= n &i(vi) (6.31) 

i= 1 

It can be shown that the characteristic function of a multi¬ 
dimensional Gaussian random variable X = {X t ,..., X n } has the 
form 

/ « l ” 

©(Uj,..., V n ) = exp I j Yj m kPk — L O 'kOlRklVkVl 

\ k= 1 Z k,l= 1 

where mu and <J k are the mean and variance of the random vector 
variable Xfc, and Rkl is an element of the correlation coefficient 
matrix. 

The probability density of the sum of random variables. If in 

(6.29) we set v k = v 2 =... = v„ = v then the multidimensional 
characteristic function changes into the one-dimensional 
characteristic function of the sum x 2 + x 2 +... + x n : 


The property of the 
characteristic function 


©£(u) = exp [jv(x 1 +x 2 +... + x„)] 

Hence, on taking the inverse Fourier transform, we can find the 
probability density of the sum. For example, if (X 1; ..., X„} are 
Gaussian, uncorrelated (and, in consequence, statistically indepen¬ 
dent) random variables, each of mean value mk and of standard 
deviation Ok, then it follows from (6.32) that 



@z(i>) = exp( jv Yj wfc-—a 2 £ at 

\ fc=l x k=l 


(6.33) 


By comparing Eq. (6.33) with Eq. (6.16), we can see that the sum 
of Gaussian random variables is likewise normally distributed, 
whereas the means and the variances are respectively added 
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together: 


m z = Z a s = Z ( 6 - 34 ) 

k= 1 k =1 


In probability theory, a far stronger assertion is proved, which is 
known as Lyapunov’s Central Limit Theorem [15]. This theorem 
states that subject to certain constraints usually satisfied in physical 
systems, the distribution of the sum of n independent random 
variables whose variances are finite and whose probability distri¬ 
butions are arbitrary tends to the Gaussian distribution as oo. 


6.3 Random Processes 

The theory of random variables deals with probabilistic 
phenomena “in statics”, that is, by treating them as some fixed 
experimental results. However, the techniques of the classical 
probability theory prove inadequate when it comes to signals 
representing random phenomena varying in time. They are tackled 
by a special branch of mathematics, called the theory of random 
processes. 

By definition, a random process X(t) is a function characterized 
by the fact that at any time t the values it assumes are random 
variables. 

Ensembles of realizations. When we deal with deterministic 
signals, we represent them by functional relations or by waveforms. 
The situation is far more* complicated when it comes to random 
processes. By noting the instantaneous values of a random process 
within a certain time interval, we obtain only a single realization of 
the random process. Theoretically, a random process is expressed in 
terms of an infinite set of such realizations which form a statistical 
ensemble. An example of such an ensemble is the set of signals 
{x l (t\ x 2 (t\ ..., Xk(t\ ...} which can simultaneously be observed at 
the outputs of absolutely indentical noise voltage generators. 

It is not mandatory for the realizations of a random process to 
be represented by functions with a complicated, irregular time 
behaviour. Frequently, we have to do with random processes form¬ 
ed by, say, all kinds of harmonic signals, U cos (cot + cp), for which 
one of the parameters, U, co or cp, is a random variable assuming 
a particular value in each realization. The random character of such 
a signal is due to the fact that we cannot predict the value of that 
parameter in advance, prior to experiment. 

Random processes whose realizations depend on a finite number 
of parameters are usually termed quasideterministic. 

The probability densities of random processes. Let X(t) be 


The central limit theo¬ 
rem 





An ensemble of reali¬ 
zations 


Quasideterministic 
random processes 


































178 


Part One. Signals 


One-dimensional (uni¬ 
variate) probability 
density 


Multivariate probabi¬ 
lity densities 


a random process defined by an ensemble of realizations, and t 1 be 
an arbitrary point of time. By noting the values {x 1 (t 1 ), x 2 (t 1 ), ..., 
xk(t x )}, assumed by the individual realizations, we take 
a one-dimensional section through the random process in question 
and observe the random variable Xf^. Its probability density 
p(x, tf) is called the one-dimensional or univariate probability density 
of the process X(t) at time t i . By definition, d P = p(x, t x )dx is the 
probability that the realizations of the random process will take at 
time t 1 the values lying in the interval (x,x + dx). 

The information that can be extracted from a one-dimensional 
(univariate) probability density is insufficient for us to judge how 
the realization of the random process changes with time. A far 
more complete description can be obtained by taking two sections 
through the random process at different instants of time, t 1 and t 2 . 
The two-dimensional random yariable { X(tf), X(t 2 )} emerging 
from this mental experiment can be represented by 
a two-dimensional or bivariate probability density, p(x 1 , x 2 , t l9 t 2 ). 

Using this characteristic, we can determine the probability of the 
event that the realization of the random process at t=t ± occurs in 
the neighbourhood of point x = x l5 and at t=t 2 , in the neighbour¬ 
hood of point x = x 2 . 

A natural generalization is the n-dimensional (nth-order 
multivariate) section through the random process (n > 2), resulting in 
the n-dimensional or nth-order multivariate probability density, p(x x , 

X 2 , ..., Xn , t !, t 2 , ..., t n ). 

The multivariate probability density of a random process must 
satisfy the usual conditions imposed on the probability density of 
a set of random variables (see Sec. 6.2). Also, the quantity p(x l9 x 2 , 
..., x n , t l9 t 2 , ..., t n ) must be independent of the order in which its 
arguments are arranged (the condition of symmetry). 

Sometimes, instead of the n-dimensional probability density, use 
is made of the n-dimensional characteristic function which is related 
to the correspondent probability density by the Fourier transform: 


0(^i, v 2 , •••> v n , t l9 t 2 ,..., t n ) 


00 00 

= J ••• J p(x 1 ,...,x„,t 1 ,...,t n )exp[j(v 1 x 1 + ... 

— oo — oo 

+ V n X n ) ] dx 1 ... dXn (6.35) 

Multivariate probability densities of a sufficiently high order 
make it possible to describe the properties of random processes to 
a sufficient degree of detail. However, such densities are frequently 
very difficult to obtain and analyse. 

Moment functions of random processes. Less detailed, but 
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satisfactory characteristics (in the practical sense) of random 
processes can be obtained by determining the moments of those 
random variables that are encountered in sections through the 
processes. Since in the general case these moments are functions of 
time arguments, they are called moment functions. 

In statistical communication theory, three moment functions of 
the lowest order have come to play the most important role. They 
are the expectation (or mean), the variance, and the autocorrelation 
function. 

The expectation 
00 

m(t) = x(t)= J xp(x,t) dx (6.36) 

— 00 

is the mean value of the process X ( t ) at the present instant of time 
t; averaging is done over the entire ensemble of process realizations. 
The variance 


<J 2 (t)= [x(t) — m(t)~] 2 = j [x(t)-m(t)~] 2 p(x,t) dx (6.37) 

— 00 

is a measure of the spread of the instantaneous values taken on by 
individual realizations in a fixed section about their mean. 
The second central moment 


K(t 1 ,t 2 )=[x(t i )-m(t 1 )] [x(t 2 )-m(t 2 )] 

00 

= j J [x(t 1 )-m(t l )'] {x(t 2 )-m(t 2 j]p(x 1 ,x 2 , t 1 ,t 2 )dx 1 dx 2 

— 00 

(6.38) 

4 

is called the autocorrelation function* of the random process X ( t). 
This function gives information about how the values of X(t) at 
one time, t l9 are related to those at the other time, t 2 , in the 
statistical sense. 

From a comparison of (6.37) and (6.38), it will be noted that 
when the time sections coincide, the autocorrelation function is 
numerically equal to the variance of the random process: 

K(t 1 ,t 2 )\ tl = t 2 = t=v 2 (t) (6.39) 

Stationary random processes. The term stationary refers to the 
fact that the statistical characteristics of a process remain un¬ 
changed with time. Random signals which are typical realizations of 
stationary random processes form an important arid widely 
encountered class of random oscillations. 


* Some authors call it the autocovariance function. See 
[20 ~\ -Translator’s note. 
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function 
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A random process is said to be narrow-sense stationary if any of 
its nth-order multivariate probability densities is invariant under 
a time shift x: 

P(x l9 ...,x n9 t l9 ...,t n ) = p(x i,.. x n , ti + x,.. t n + x) (6.40) 

If we limit ourselves to the requirement that the mean m and the 
variance a 2 be independent of time, but let the autocorrelation 
function be only dependent on the time difference x = \t 2 — t 1 \, that 
is 


K(t l9 t 2 )=K(x) 


Wide-sense and nar¬ 
row-sense stationarity 


then the random process will be wide-sense stationary. It is obvious 
that the property of wide-sense stationarity stems from the 
narrow-sense stationarity, but not the other way around. 

As follows from the definition of a stationary random process, 
the autocorrelation function shows even symmetry: 

K(t) = K(-t) 

Also, the values of this function at any x do not exceed the values 
at x = 0: 


K{x)^K( 0) = a 2 (6.41) 

The proof is as follows. From the obvious inequality 
{[x (t) — m] — [x (t + x) — m]} 2 ^ 0 
it follows that 

[x(t) - m] 2 - 2[x(t) - m] [x(t + x) - m] + [x(t + x) - m] 2 


= 2g 2 -2K(x)^0 


• 

The correlation coeffi¬ 
cient of a random pro¬ 
cess 


from which Eq. (6.41) results immediately. 

Frequently it is convenient to introduce the normalized 
autocorrelation function 


R(t)=K(t)/g 2 (6.42) 


also called the correlation coefficient of a stationary random 
process, for which R{ 0)—1. 

To illustrate the concept of a stationary random process, let us 
consider two examples. 


Example 6.5. A random process U ( t ) is formed by realizations of 
the form u(t) = I/ 0 cos(co 0 t + cp), where U 0 and co 0 are constant, 
whereas the phase angle cp is a random variable uniformly distributed 
over the interval — n ^ cp < n. 
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Since the probability density function of the phase angle is 
Pi p = 1/271 

the expectation (mean) of the process will be 

_ n 

u= U 0 cos(co 0 t + q>) = (U 0 /2n) j* cos(oo 0 t + cp)dcp = 0 

— 7t 


▲ 

Solve Problem 9 


Similarly, the variance is 
a 2 = (u - u) 2 = U 2 0 cos z ( — co 0 £ + <p)= U 2 /2 
Finally, the autocorrelation function is 
K (t 1 , t 2 ) = Uq cos (co 0 t 1 + cp) cos (co 0 t 2 + cp) 

= (Uo/2) {cos [co 0 (t 1 + t 2 ) + 2cp] + cosco 0 (t 2 - t x )} 

= ([/o/2)cosco(t 2 — ti) 

Thus, the random process in question satisfies all the conditions 
necessary to assure wide-sense stationarity. 

Example 6.6. Consider a random process made up of realizations 
u(t)= U q cos (co 0 t + cp 0 ), such that co 0 and cp 0 are fixed numbers, and 
U 0 is a random variable distributed in an arbitrary fashion. 
The expectation 

u= U 0 cos (co 0 £ + cp 0 ) 


will be independent of time only when U 0 = 0. Therefore, in the 
general case the random process in question will be nonstationary. 


Ergodicity. A stationary random process X ( t ) is called ergodic, if 
its ensemble averages may be replaced with its time averages. 
Averaging is performed over a single realization x (t) whose 
duration T tends to infinity. Denoting a time average by angle 
quotes, < >, we will write the expectation (mean) of an ergodic 
random process as 


m = <x(t)>= lim 
T- oo 


*/■ 


x(t)dt 


(6.43) 


which is equal to the constant term of the selected realization. 
The variance of such a process is 


a 2 = < [x (t) — m\ 2 ) = lim 


1 

~T 


[x (t) - m] 2 d t = <x 2 (t )> — m 2 (6.44) 


Since <x 2 > is the mean power in a realization, and m 2 is the 
power in the constant term, the variance has the easy-to-grasp 


Most random pro¬ 
cesses in telecommu¬ 
nications are ergodic 


The physical signifi¬ 
cance of the variance 
of a random process 
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meaning of the power in the fluctuating component of the ergodic 
process. 

The autocorrelation function is found in a similar way: 


K( x) = < [. x(t ) — m] [: x(t + x) - m] > = <x(t)x(t + x)> — m 2 


T 


= lim — 
t T 

1 ->oo . 


x(t)x(t + x)d t — m 2 


(6.45) 


For a random process to be ergodic, it must above all be 
wide-sense stationary. A sufficient condition for ergodicity is that 
the autocorrelation function should tend to zero as the time 
translation x increases without bound: 



Measuring the proba¬ 
bility density of a 
random process 


lim K (x) = 0 (6.46) 

t-+oo 

It is proved in mathematics that the above requirement can be 
relaxed. As has been found, a random process is ergodic, if the 
Slutsky condition [14] is satisfied: 

T 

lim — |K(x)dT = 0 (6.47) 

T-* 00 ^ J 

0 

For example, Eq. (6.47) holds for a harmonic process with 
a random initial phase (see Example 6.5). 

Measuring the characteristics of random processes. If a random 
process is ergodic, its realization of a sufficient length is a “typical” 
representative of the entire ensemble. A sufficiently complete 
characterization of the entire process can be developed by analysing 
this only realization. 

A device to measure the univariate probability density of 
a random process can be built as follows. The univariate 
probability density of an ergodic random process should be treated 
as a quantity proportional to the relative time during which the 
realization exists at a level between x and x + Ax. Suppose that we 
have a network with two inputs one of which accepts the 
realization under analysis, x(t), and the other accepts a constant 
reference voltage whose level x 0 can be adjusted within certain 
limits. The output of the device delivers rectangular video pulses of 
constant amplitude, the start and finish of which are determined by 
the instants when the instantaneous value of the random signal 
corresponds to either x 0 or x 0 + Ax. If, now, we measure with an 
ordinary pointer-type instrument the average current produced by 
a train of video pulses, the meter indications will be proportional to 
the probability density p(x 0 ) to within a constant. 

Any sufficiently sluggish pointer-type instrument can be used to 
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find the expectation (mean) of a random process [see Eq. (6.43)]. 

As follows from Eq. (6.44), the instrument used to measure the 
variance of a random process should have at its input a capacitor 
to block the passage of the d. c. component. The subsequent steps 
in the procedure, namely squaring and time-averaging, are usually 
performed by an ordinary, sufficiently sluggish square-law 
voltmeter. 

The operating principle of the instrument measuring the 
autocorrelation function (called the correlator or the correlation 
detector) arises from Eq. (6.45). Here, after the d.c. component is 
filtered out, the instantaneous level of the random signal is divided 
between two channels one of which delays its share of the signal for 
a time x. From the two channels, the divided signals are fed to 
a multiplier. The product thus formed is in turn applied to 
a sluggish element which produces an averaged output. 

The above techniques of measuring the characteristics of random 
processes are based on analog operations. Of late, there has been 
a growing trend towards using digital instruments for the purpose. 
For their operation they depend on the sampling of the random 
signal in question and the processing of the resultant sampled 
numbers in accord with Eqs. (6.43) through (6.45). 

The cross-correlation function of two random processes. In many 
cases it is of interest to know the extent to which two stationary 
random processes, X and Y, are statistically related to each other. 
For this purpose, we introduce the cross-correlation of the two 
processes 


K xy(t 1 ,t 2 )=[x(t 1 )-m x ] [y (t 2 ) — m y ] 


K yx (t ly t 2 ) = [y(t x ) - my] [x(t 2 ) - m x ] 


(6.48) 


Random processes are called stationary related if the 
cross-correlations K xy (t 1 ,t 2 ) and K yx (t 1 , t 2 ) depend only on the 
time difference T = t 2 — t 1 , and not on t L and t 2 themselves. Then 
the cross-correlation becomes the cross-correlation function * such 
that 


K xy (i) = K yx ( — x) (6.49) 

Suppose that the random processes X ( t ) and Y ( t ) are statistically 
independent in the sense that for the instantaneous values x = x (t) 
and yx = y(f + x) the bivariate probability density is 

p(x,y T ) = p(x)p(y T ) 



Voltmeter 


Ttf<t) 

The correlator (corre¬ 
lation detector) 

▲ 

Work Problem 15 


Stationary related ran¬ 
dom processes 


* Many authors call it the cross-covariance function -Translator's note. 
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A. A. Markov (1856- 
1922), a prominent 
Russian mathemati¬ 
cian 


irrespective of the value of x. Then 

00 00 

K X y( t)= I (x - m x )p(x)dx j (y x — m y ) p (y T ) dy x = 0 

— 00 “00 

or, in words, from the statistical independence it follows that the 
two processes are uncorrelated. In general, the converse is not true. 

Stationary Gaussian random processes. These mathematical 
models of random signals are widely used in communication theory 
in order to describe the statistical phenomena due to a large 
number of independent random variables, that is, when the Central 
Limit Theorem applies. By definition, the nth-order multivariate 
probability density of a stationary Gaussian process depends on 
n -1 time arguments x;= ti— t l9 i = 2, 3, ..., n in the following way: 

p(x 1 ,..., x n , x 1 ,..., x n _ x ) = (J n^ 2 n y i / 2 j) 1 l 2 


x exp 


n 


1 

2 Do 2 


l 


Dij(xi — m)(xj — m) 


(6.50) 

Here, the notation is the same as is used in Eq. (6.26). The elements 
of the correlation matrix of this random process can be found from 
the normalized autocorrelation matrix Ry = R (x; — x/). 

Frequently, use is made of the bivariate Gaussian probability 
density 


p(x i,* 2 ,x) = 
x exp < — 


2na 2 ]/1 — i? 2 (t) 

(x x — m) 2 — 2R (x) (x 1 — m) (x 2 — m) 4- ( x 2 — m) 2 
2cr 2 [1 — R 2 (x)] 


(6.51) 


Stationary Gaussian processes occupy an exceptional place 
among all the other random processes-any of the multivariate 
probability densities can be specified by only two characteristics: 
the expected value (mean) and the autocorrelation function. This is 
the reason why most of the results obtained in statistical 
communication theory have special reference to stationary 
Gaussian processes. 

Markov processes. In concluding this overview of the general 
methods used to describe random signals, it is worth while to dwell 
on a rather special mathematical model widely used in 
communication theory. What we mean are the so-called Markov 
random processes. 

Suppose that the state of a physical system can be characterized 
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by one of the numbers belonging to a finite set x l9 x 2 , ..., xn. The 
change of state occurs in a random manner at fixed instants of time 
t x < t 2 < t 3 < .... Such a random process is called the simple 
Markovian chain if the probability of observing the system in the 
state Xi during the kth step solely depends on the state Xj in which 
the system resided during the previous, (k — 1 )st, step. The states 
associated with the steps (k-2), (/c-3), ... are immaterial. 

On designating this transition probability as py (i, j = 1, N\ 
we may introduce the following matrix 


n = 


Pi 1 Pi 2 PlN 


_PN i PN 2 ••• PNN J 


which completely describes the statistical properties of the 
Markovian chain. 

The basic problem that has to be solved in the theory of 
Markovian chains may be stated as follows: Given the matrix 
II and the initial state of the process, we are to find the probability 
that the system will reach some fixed state x m in exactly n steps. 

The idea of Markov random processes can be generalized to the 
continuous-time case such that the realizations can likewise take on 
a continuous set of values. 

It is to be stressed that the Markovian properties of a random 
process are related to the dynamic behaviour of the associated 
physical system and are in no way indicative of the form of the 
probability density. Among other things, a Markov random process 
may or may not be a Gaussian process. 

There is a large body of literature on the theory and applications 
of Markov random processes (see, for example, [3] and [14]). 


Summary 

00 Statistical relations are brought out in the study of physical systems formed by a large 
number of smaller subsystems. 

<00 The principal characteristics of a random variable are its distribution function and its 
probability density. 

00 The numerical parameters used to describe a random variable are its moments, such 
as the expected value (or mean) and the variance. 

30 The statistical relations existing between the individual components of an nth-order 
(vector) random variable are defined in terms of joint second-order moments called 
correlation coefficients. 

00 Uncorrelated Gaussian variables are statistically independent. 

OO Under the Central Limit Theorem, in the limit m-+oo the sum of m independent 
random variables is normally (Gaussian) distributed. 
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; X- A random process is specified by an infinite ensemble of its realizations. 

The most important moment functions of a random process are its expected value 
(mean), variance, and autocorrelation function. 

A random process is called stationary if its statistical characteristics are time-invari¬ 
ant. 

The characteristics of stationary random processes which possess the property of 
ergodicity may be investigated experimentally by analysing only one realization. 
The expected value (mean) and the autocorrelation function make it possible to 
calculate any nth-order multivariate probability density of a stationary Gaussian 
random process. 

Realizations of Markov processes are chains of randomly changing states; the 
probability of observing any one state in a given step solely depends on the nearest 
previous state. 


Review Questions 

1. State the axioms of probability theory. 

2. What is the difference between the population probability and the sample probability? 

3. Name the basic properties of the probability density of a random variable. 

4. Formulate the principle by which the average values of the quantities functionally 
related to random variables are found. 

5. What is the procedure for finding the probability density of a function of a random 
variable in the case of a unique and a non-unique relationship? 

6. How is the probability density of a random variable related to its characteristic 
function? 

7. What is the meaning of correlation between two random variables? 

8. Which requirement is more rigorous: the uncorrelatedness or the statistical 
independence of random variables? 

9. List the salient features of an nth-order Gaussian random variable. 

10. State the Central Limit Theorem. 

11. What is the difference between a random process and a random realization? 

12. An experiment has yielded the following realization of a random signal: 



Can it belong to an ensemble of realizations of a Gaussian random process in principle? 
How valid is such a statement? 

13. Define (a) a wide-sense stationary random process and (b) a narrow-sense stationary 
random process. 

14. What is the principal property of an ergodic random process? 

15. What is the physical meaning of the variance of an ergodic random process? 

16. Define the cross-correlation function of two random processes. 
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Problems 

1. When a message is transmitted over 
a communication channel, an average of 
0.5% symbols are received in error. The 
message transmitted is 120 symbols long. 
What is the probability of faithfully 
reproducing the transmitted message? 

2. The probability density of a random 
variable X is 

p(x) = aexp(-b\x\) 

Find the relation between the numbers 
a and b, stemming from the condition of 
normality. 

3. A random variable X is uniformly 
distributed within the interval (0, 5). The 
probability of detecting this variable at the 
ends of the interval is the same and equal to 
0.3. Calculate the distribution function and 
the probability density for the random 
variable in question and construct the 
applicable plots. 

4. Find the mean and variance for the 
random variable of Problem 3. 

5. Find the mean and variance for 
a random variable whose probability density 
is 

p (x) = (a/2) exp (— a | x |) * 
for a > 0. 

6. The characteristic function 0(u) of 
a random variable X has the form 

@(v)=l/(\+v 2 ) 

Find the probability density p(x) of this 
random variable. 

7. Find the relation between the 
probability density p(x) of a random 
variable X and the probability density p(y) 
of another random variable Y obtained by 
the following functional transformation: 

y = exp( —x 2 ) 

8. The joint probability density p(x 1 ,x 2 ) 
of a second-order random variable has the 


form 

p(x i, x 2 ) = {a 2 /n) exp [ — a 2 (xj + x 2 )] 

Find the probability densities, means and 
variances of x x and x 2 . 

9. Prove that for a wide-sense stationarity 
of a random process X (t) with realizations 

x(t) = A cos oo£ + B sin cot 

it is necessary and sufficient for the random 
variables A and B to have the following 
properties: 

(a) A = B = 0; 

(b) cj 2 a = g 2 b ; 

(c) AB = 0 

10. A random process Z(t) is the sum of 
two Gaussian random processes X(t) and 
Y(t) which have time-invariant means m x 
and m y and time-invariant variances g 2 
and a 2 , respectively. Find the univa¬ 
riate probability density of the total 
process. 


Advanced Problems 

11. There is a signal which is the sum of 
harmonic waves of the same frequency. The 
components have the same amplitude equal 
to 5 V. The initial phases of the components 
may take on independently only two values, 
0° and 180°. The number of components is 
30. Find the probability that the resultant 
amplitude will exceed 40 V. 

12. Prove that if a random variable Z is 
the sum of two independent random 
variables X and Y, then its probability 
density is the convolution of the individual 
(marginal) densities: 

pAz)= j p y (Qp x (z-Qdt; 

13. A random point g(x 1 ,x 2 ) is uniformly 
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distributed in a square of side a: 



a 


Find the mean and variance for the length 
of the random segment RQ joining the point 
to the centre of the square. 


14. The coordinates (x, y) of a random 
point in a plane are independent Gaussian 
random variables of mean value m x = m y = 0 
and of variance Gx = Oy = cr 2 - Find the 
probability density of the length of the 
random position vector of the point. 

15. Consider the feasibility of an 
instrument for measuring the bivariate 
probability density of an ergodic random 
process. 


Chapter 7 

The Correlation Theory 
of Random Processes 


In addition to a complete description of the properties of random 
signals with the aid of multivariate probability densities, a simpler 
approach may be taken in which random processes are 
characterized by their moment functions. The theory of random 
processes based on the use of at most second moment functions 
has come to be known as correlation theory. In this chapter we set 
out to demonstrate that there is a deep and close relation between 
the correlation and spectral properties of random signals. 

7.1 The Spectral Representation of Stationary 
Random Processes 

In Chap. 2, the spectral theory has been set forth for 
deterministic signals. Since individual realizations are probabilistic 
in their behaviour, the methods of spectral analysis cannot be 
carried over to the theory of random processes directly. However, 
a number of important spectral characteristics of random waves can 
be derived by taking the Fourier transforms of some functions 
formed by averaging the realizations. 

The spectrum of realizations. Consider a stationary random 
process X ( t ) of mean value zero, x = 0. A single realization of this 
process is a deterministic function which can be represented by the 
following spectral expansion: 

j 00 

x{t) = —— f 5(co)exp(/(oi)dco (7.1) 

271 — oo 

with a certain deterministic spectrum 5(co). 

In order to describe the entire ensemble of realizations that form 
the process X(t\ we must assume that the S(oo)’s are themselves 
random functions of frequency. Thus, a random process in the time 
domain is connected to another random process in the frequency 
domain. There is a one-to-one correspondence between the 
individual realizations of the two processes. If the realizations of 
a random process are represented as in Eq. (7.1), the process is said 
to appear in a spectral representation. 

The crucial question in the theory of random processes is: What 
properties should the random functions S( oo) possess for the process 
X(t) to be stationary ? 

Properties of a random spectrum. In order to answer the above 
question, we will define the mean of the instantaneous values over 


# 

Correlation theory 


• 

Spectral representa¬ 
tion of a random pro¬ 
cess 
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For a complex process, 
its real and imagina¬ 
ry parts must be 
considered separately 


Note that S(co) takes 
on complex values 


Delta correlation 


the ensemble: 

1 00 _ 

x =- j S'(co) exp (/cot) dco = 0 

2n -oo 


The above equality will be satisfied identically for any t, if we 
require that 

SW) = 0 (7.2) 


In other words, the random spectrum of individual realizations of 
a stationary random process must have a mean value of zero at all 
frequencies. 

Now we should determine the conditions under which the 
autocorrelation function K( t) will depend solely on the time shift 
x between the sections. Since x(t) is a real signal, we may use, in 
addition to Eq. (7.1), also the equality 


1 00 

x(t) = x*(t) = — j S* (cd) exp ( — 7 co t) dco (7.3) 

27r_oo 


Using the spectral expansion of the random signal, we may 
write its autocorrelation function as 


K(t) = x(t)x(t + t) = x*(t)x(t + t) 

= 7 TT 2 - If S(©)S*(co') exp (/cot) 

( 2rc ) -00 

x exp [/ (co — co') t] dco dco' 

| 00 00 

= 7T^r S exp (/cor)dco j S(co)S*(<b') 

(ZTC) —oo —oo 


x exp[/(co — co')f] dco' 


(7.4) 


Here the inner integrand contains the factor S(co)S*(co') which has 
the meaning of the autocorrelation function of a random spectrum. 
For K(t) not to be dependent on t, it is necessary, as is seen from 
Eq. (7.4), to require that the following proportionality be satisfied: 


S (to) S* (co') ~ 5 (co — co') (7.5) 

Thus, the random spectrum S(a>) of a stationary random process 
has a very specific structure: The spectra corresponding to any two 
non-coincident frequencies are mutually uncorrelated, whereas the 
mean square (variance) of the random spectrum is large without 
bound. This form of statistical association is called delta correlation. 

The power spectrum of a stationary random process. Let us 
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introduce a frequency-dependent proportionality factor in Eq. (7.5) 
and re-write the equation as follows: 

S(co)S*(co') = 27tJT(ce>)5(oo - co') (7.6) 

The function W( co), playing a fundamental role in the theory of 
stationary random processes, is called the power spectrum * of the 
process X(t). 

On substituting (7.6) into (7.4), we obtain an important result: 


1 00 

K( x) =- f JF(co)exp.(/cox)dco (7.7) 

2n -oo 


Thus the autocorrelation function and the power spectrum of 
a stationary random process of mean value zero are each other's 
Fourier transforms. This relation is also called the Wiener-Khinchin 
(W-K) theorem. 

Hence, 


00 

JF(co) = j K(x)exp(- 7 ’cox)dx 

— 00 


(7.8) 


To clarify the physical significance of the power spectrum, let us 
set x = 0 in Eq. (7.7). Then, since K( 0) = cf 2 , we get 

1 00 

a 2 =—— f PF(co)dco (7.9) 

2k — oo * 

The variance a 2 , equal to the mean power in the stationary random 
process, is thus the sum of the contributions from all frequencies. 
The quantity IF(co) is a measure of the mean power in the process 
per unit of bandwidth in the vicinity of the chosen frequency co. 
Physically, the power spectrum is real and non-negative: 

W( co)^0 (7.10) 

This property imposes rather rigorous constraints on the form of 
the permissible autocorrelation functions. (We have already run 


* The alternative terms are the power density spectrum (Handbook of 
Automation, Control and Computation , Ed. Eu. M. Grabbe, S. Ramo, and 
D.E. Wooldridge. New York: John Wiley and Sons, Inc., 1958), the spectral 
density (C.W. Helstrom, Statistical Theory of Signal Detection. Oxford: 
Pergamon Press, 1968), the power spectral density (L. E. Franks, Signal 
Theory. Englewood Cliffs, New Jersey: Prentice Hall Inc., 
1969).- Translator's note. 


The power spectrum 
of a random process 


If a random process 
is voltage, its power 
spectrum has the di¬ 
mensions of V 2 s rad" 1 
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A 

Solve Problem 1 


A 

Solve Problem 2 


The one-sided power 
spectrum may have the 
dimensions of, say, 
V 2 Hz 1 


into a similar situation in Chap. 3 in connection with the 
correlation properties of deterministic signals.) 

One more important point should be stressed. The power 
spectrum of a stationary random process, being always real, does 
not carry any information about the phase relations between the 
individual spectral components. Therefore, it is impossible in 
principle to reconstruct any individual realization of a random 
process from its power spectrum. 

The one-sided power spectrum. Since K (x) is an even function of 
x, the corresponding spectrum W( go) is likewise an even function of 
the frequency co. Therefore, the Fourier transform pair, (7.7) and 
(7.8), can be written, using only the integrals between semi-infinite 
limits: 


1 00 

K(t) = — J JT(co)coscoxdco (7.11) 

n o 

00 

W( co) = 2 J K(t) coscoxdx (7.12) 

0 

It is expedient to introduce the so-called one-sided power spectrum 
F( co) of a random process, by defining it as follows: 


F( co) = 


f W((o)/k for co > 0 
| 0 for co < 0 


(7.13) 


The function F(co) makes it possible to express the variance of 
a stationary random process as an integral over positive (entirely 
real or physical) frequencies: 


g 2 = K( 0)= j F(co)dco 
o 


(7.14) 


By the same token, we may define the one-sided power spectrum 
F(f), which is the mean power in the process per unit frequency 
interval (1 Hz): 


F(f) = 


2 W(2nJ) 
0 


for /> 0 
for /< 0 


such that 

00 

ct 2 = \F(f)df 
0 

The W-K theorem is a most important tool in the applied theory 
of random processes and comes in useful when handling a large 
varietv of problems. Consider some of the most typical examples. 
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Example 7.1. A random process with an exponential 
autocorrelation function. 

Suppose we know that the process X(t) has an autocorrelation 
function of the form 

K(x) = cr 2 exp(-a|x|) 

in which a is some real and positive parameter. On the basis of 
Eq. (7.12), the associated power spectrum is 

00 

JT(cd) = 2a 2 J exp( — ax)coscoxdx = 2aa 2 /(a 2 + co 2 ) 
o 

Hence, the one-sided power spectrum is 
F (co) = (2/n) aa 2 /(a 2 + co 2 ) 

From the accompanying plot it is seen that the power spectrum of 
the process in question has a well-pronounced low-frequency 
character-the power spectrum is a maximum at frequency zero. 

Example 7.2. Suppose that the power spectrum of a random process 
X (t) is described by a Gaussian function (a quadratic exponential 
function) 



ff'o 

w 




U) 


-w, im o oj, im 


W(co) = W 0 exp( — Pco 2 ) 

Let us find the autocorrelation function by using Eq. (7.11): 

00 

K W = (W 0 /k) J exp(- Pco 2 ) coscot doo = (W 0 /2)|/(l/jtp) exp(- t 2 /4P) 
0 

Thus, a Gaussian power spectrum leads to a Gaussian 
autocorrelation function as well. 

The variance of the random process in question is 

v 2 = WJ2]frf 

Example 7.3. A stationary random process with a band-limited low- 
frequency power spectrum. 

Let the process X ( t ) be characterized by a power spectrum of the 
form 



JF(co) = 


W 0 for - COlim < CO < COlim 
0 elsewhere 


Using Eq. (7.11), we find the autocorrelation function to be 


®l im 


K (t) = ( WJn) j cos cot dco = ( W 0 coi im /7t) (sin CDi im T/coi im T) 
0 


7-728 


The variance of the process is 
G 2 = K (0) = W 0 COlim/jr 
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In this case, it is convenient to use the one-sided power spectrum 


_ f -F 0 = (%/ n ) for 0 < CO < COli m 

[ 0 elsewhere 

which makes it possible to write the expression for the variance as 
an easy-to-memorize product of the power spectrum by the fre¬ 
quency band occupied by the signal: 

a 2 = Fq COlim 

It is important to note that the autocorrelation function of the 
process in question takes alternate signs, the change of sign 
occurring at each shift x which is a multiple of rc/a>ii m . In other 
words, as x increases, the mean of the product x(t)x(t + x) will first 
be positive, then negative, then again positive, and so on. This 
behaviour of the autocorrelation function points to the 
quasi-periodicity of any realization of the random process (of course 
in a probabilistic rather than absolute sense). 

From a physical point of view, the quasi-periodic realizations of 
random processes occur when the random waves are sums of 
a large number of independent r.f. pulses. 



A quasiperiodic reali¬ 
zation 



The correlation time. In general, the random processes of concern 
to statistical communication theory have the following property: 
Their autocorrelation function K(t) approaches zero as the time 
shift x increases. The faster the decrease in K(x), the weaker is the 
statistical relation between the instantaneous values of a random 
signal observed at two different instants of time. 

It is convenient to evaluate numerically the rate of change of 
realizations of a random process in terms of the correlation time 
x CO r, defined as 


, 00 00 

Tcor = “iFTfvT 1 K(T,dT= 1 R{x)dx 
^ 0 0 


(7.15) 


The two shapes are 
the same in area 


A 

Solve Problem 5 


Roughly speaking, we can predict in probabilistic terms the 
behaviour of any realization of a random process over the time 
interval x CO r, if we know the behaviour of this realization in the 
“past”. Any attempt, however, to predict this behaviour for a time 
substantially exceeding the correlation time would be futile-beyond 
that interval isntantaneous values of the process are nearly 
independent random variables, that is, the mean value of the 
product x(t)x(t + T) is close to zero. 

The effective bandwidth. Let the random process in question be 
characterized by a one-sided power spectrum, F(co), such that 
Fmax is the extremal value of the function. Mentally we may replace 
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this random process with any other process in which the power 
spectrum is constant and equal to F max within the frequency band 
A(o e ff chosen such that the mean power is the same in both 
processes: 

00 

F maxA(0eff= J F(«))dco 
0 

Hence the expression for the effective bandwidth of a random 
process is 


00 

Acoeff = (1/Fmax) J F (oo) dco (7.16) 

0 


This numerical characteristic is frequently used in engineering 
calculations as it provides a ready means for finding the variance of 
a noise voltage: 

O 2 = F max Aco e ff 

For example, if we know that F max = 5x 10" 9 V 2 s and Aco e ff = 
= 3 x 10 5 s" 1 , then a 2 = 1.5 x 10 -3 V 2 . Hence, the rms noise 
voltage is cr = j/a 2 = 39 mV. 

Obviously, the effective bandwidth of a random process can be 
specified in more than one way. For example, it may be defined as 
the interval at whose boundaries the power spectrum decreases to 
0.1 Fmax. In any case, the correlation time x CO r and the effective 
bandwidth Aco e ff will be connected by the uncertainty relation 

AcOeffXcor = 0(1) 

arising from the properties of Fourier transforms (see Chap. 2). 
Thus, the broader the bandwidth of noise, the more chaotically its 
realizations vary with time. 

White noise. In communication theory, the term “white noise” 
refers to a stationary process whose power spectrum is the same at 
all frequencies: 


W(ay) = W 0 = const 


The term “white noise” suggestively stresses the analogy with 
“white” (natural) light in which all the spectral components within 
the visible region have about the same intensity. 

By the W-K theorem, the autocorrelation function of white noise 

K( x) = ( W 0 /2n) J exp (/cox) dco = W 0 6 (x) (7.17) 

— 00 


A 

Solve Problem 4 


White noise 


7 * 
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which is an indication of an infinitely large mean power in white 
noise. 

Alternatively, white noise is referred to as a delta-correlated 
random process. The uncorrelatedness of instantaneous values of its 
realizations implies that they vary with time at an infinitely high 
rate: However small the time interval x may be, the instantaneous 
value of the signal can change over that time by any value we may 
like to specify in advance. 

White noise is an abstract mathematical model, and a physical 
process answering this model is, of course, non-existent in nature. 
This does not prevent, however, using it as an approximation for 
sufficiently broadband real random processes in cases where the 
passband of the circuit responding to the signal is substantially 
narrower than the effective bandwidth of the noise. 


Convergence in pro¬ 
bability 


7.2 Differentiation 

and Integration of Random Processes 

In this section, we will be concerned with the properties 
displayed by realizations of random processes subjected to 
differentiation and integration. It will be shown that the most 
important characteristic defining the differentiability of a random 
process is its autocorrelation function. 

Probabilistic treatment of convergence and continuity. In the 
theory of random processes we have somewhat to extend the 
classical concept of the convergence of a sequence of numbers 
towards their limit. Thus, if {x n } is a random sequence, then it is 
not always that in the limit m, h -► oo the difference \x m — x n \ should 
be less than any predetermined number, however small. 

A random sequence {x n } is said to converge towards 
a nonrandom number x in probability if, for any e > 0, 

lim P(\x n — x \ >e) = 0 (7.18) 

n~* oo 

The requirement for convergence in probability, applied in all 
problems involving random processes, is less rigorous than the 
classical criteria for the convergence of deterministic sequences. 

The property of continuity for a random process is defined in 
a similar way. A random process X(t) is said to be continuous at 
point t = t 0 , if the following limiting equality is satisfied 


Continuity of a random (7.19) 

process 

The derivative of a random process. Suppose that any realization 
x(t) of a random process X(t) can be applied to a differentiating 
network which produces at its output a new realization y(t) = 
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= dx/dt. The collection of realizations y(t) forms a random process 
Y(t) called the derivative of the process X ( t ). Symbolically, this is 
stated as follows: 

Y(t) = dX/dt 


Let X ( t ) be a stationary random process of a known mean value 
x = m x . In order to find the mean of the derivative, we should take 
the average over realizations: 


m y = y — dx/dt = — m x = 0 
dt 


(7.20) 


To sum up, the differentiation of any stationary random signal 
produces a new random signal of mean value zero. 

Finding the autocorrelation of a derivative poses a more difficult 
problem. Without loss of generality, let us suppose that the mean 
value of the original process is m x = 0. (If this should be not the 
case, we may always choose a new process X ( t ) whose realizations 
are x (t) = x ( t ) — m x .) Taking advantage of the fact that 


dx _ x(t + At) —x(t) 

—— = lim--- 

dt At 

we may write the autocorrelation function of the derivative as 
K y (x) = y(t)y(t + x) 


lim x (* +At) —x(t) x(t + x + At) — x(t + x) 
At-o At At 


x (t + At) x (t + x + At) 


— x (t + At) x (t + x) — x (t) x (t + x + At) + x (t) x(t + x) 

The four terms within the square brackets are the autocorrelation Work Problem 7 
functions of the original process, as found for various values of time 
delay. It is an easy matter to see that 

K y (x) = lim [2 K x (x) - K x (x - At) - K x (x + At)] 

Af-*0 (At) 

The right-hand side of the above equality can be recognized as 
a finite-difference representation of the second derivative of K x (x ), 
taken with the opposite sign. This leads us to an important formula 



K y ( t) = -Ki( t)= -o 2 x R"(x) 


(7.21) 
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Differentiable and nondifferentiable random processes. By 

definition, a random process X(t) is differentiable if its derivative 
has a finite variance. 

In accord with Eq. (7.21), the variance of a derivative is 
CTy = -Kx( 0)= -o 2 xR"( 0) 

Therefore, for a random process to be differentiable it is necessary 
that the second derivative of its autocorrelation function be finite at 
zero-crossing and, in consequence, the first derivative be continuous 
at that point. 

Nondifferentiable random processes are those for which the 
autocorrelation function is of the form a 2 exp( - a| x|), considered 
in Example 7.1. On differentiating this function, it can be easily 
seen that at zero-crossing the derivative changes in magnitude 
stepwise by — 2a 2 a. 

In communication theory one has often to deal with random 
processes whose autocorrelation functions have the form 

K (x) = a 2 (l + a|x|)exp(-a|x|) (7.22) 

The first derivative of the above function 

— a 2 cr 2 x exp (— ax) for x > 0 

— a 2 a 2 xexp(ax) for x<0 

is continuous at zero-crossing, so the autocorrelation function in 
(7.22) is associated with a differentiable process. Any real random 
signals are always sufficiently continuous, that is, they are 
differentiable. In theoretical studies, however, use is often made of 
mathematical models corresponding to nondifferentiable processes. 
As a rule, this is the case when realizations of a random process are 
formed from a large number of independent variables. Although the 
contribution by one such variable (say, the current pulse produced 
by the motion of a single electron) is negligible, precisely these 
components determine the “fine structure’ of the realization. In 
consequence, realizations of such a process can, in the limit, take 
Solve Problem 8 the form of a function everywhere continuous, but nowhere 

differentiable. 

The power spectrum of a derivative. We set out to establish the 
relation between the power spectra of an original process and of its 
derivative. Let X(t)*-*W x ( co). By the W-K theorem, the 
autocorrelation function of the original process is 

1 00 

K x (t) = — j W x (to) exp (/cox) do 
271 

On the basis of (7.21), the autocorrelation function of the 



The condition for the 
differentiability of a 
random process 
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derivative is 

1 00 

Ky( T ) = ^r~ I co 2 W x (co) exp (/cox) dco 

-oo 

Hence, the sought-for relation is 

W y (©) = co 2 W x (co) (7.23) 

It is worth noting that the low-frequency components in the 
power spectrum of the derivative are weakened and the high-fre¬ 
quency components are boosted. On the basis of Eq. (7.23) we can 
say whether the process X ( t ) is differentiable from the properties of 
its power spectrum: The variance of the derivative will be finite, if 
the integral 

1 00 

Gy = - j co 2 IT x ((o)dco < -hoo 

2n 

exists. 

For example, in the case of a random process having a low-fre¬ 
quency power spectrum (see Example 7.3), the variance of the 
derivative is 

®!im 

ct> 2 = (WJ2n) J g> 2 dco = W>L/3* 

Therefore, the process involved is differentiable. 

Correlation between a random process and its derivative, in 

many communication-theory problems it is interesting to know the 
extent to which a random signal and its derivative are related to 
each other statistically. In. order to answer this question, let us find 
the cross-correlation function K xy (i) of the random processes X(t) 
and Y(t) = dX/dt, assuming that both are stationary and of mean 
value zero. Then 

_ d d _ 

K xy (x) = x(t)y(t + x) = x(t)-—x(t + x) = — x(t)x(t + x) 

dx dx 

Hence, 

K xy (T) = dK x (T)/dx (7.24) 

As will be recalled, the function K x (x) shows even symmetry. 
Therefore, for x = 0, the derivative dK x /dx vanishes always. On the 
basis of Eq. (7.24), we may conclude that the instantaneous values of 
a signal and of its derivative, observed at the same instant of time, are 
uncorrelated random variables. A stronger assertion can be made 
with regard to Gaussian random processes. Here, a random signal 
and its derivative are statistically independent. 

The integral of a random process. Let the random process Z ( t ) 


Resort is made to the 
differentiation of an in¬ 
tegral with respect to 
the parameter 


A random process and 
its derivative are un¬ 
correlated 
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The integrator 


The input random sig¬ 
nal 




and the outputran- 
dom signal 



of an integrator 


be called the variable-upper-limit definite integral of a random 
process X(t) if the following correspondence exists between their 
realizations z(t) and x(t): 

t 

z(t)= §x(t 1 )dt 1 (7.25) 

o 

The physical significance of this is that the signals z(t) are observed 
at the output of an ideal integrator, with the input signals x(t) 
commencing to arrive at time zero. 

If the process X ( t ) is stationary and of mean value m x , the mean 
value of the signal at the output of the integrator will be 

t 

m z = z(t) = $x{t i )dt 1 = m x t (7.26) 

o 

Thus, the condition m x # 0 immediately leads to the nonstationarity 
of the random process Z(t). 

However, even if the input signal is of mean value zero, the signal 
at the output of an ideal integrator will be a realization of 
a nonstationary random process. To prove this, let us find the 
autocorrelati on function of the integral: 

KAh, t 2 )=Yi x(t')x(t")dt'dt" 

0 0 

= Jf jf x(t')x(t")dt'dt" = j j K x (f, t")dt'dt” 

0 0 0 0 

If the process X(t) is stationary, the argument of the 
autocorrelation function under the integral in the above equation 
will be the time difference t" — t', so 

K z (h , t 2 ) = j S K x (t " ~ Odt'dt" (7.27) 

0 0 


Since the right-hand side of Eq. (7.27) depends directly on t x and 
t 2 , rather than on their difference, the signal at the integrator out¬ 
put cannot be a stationary random process. 

The nonstationarity of the integral of a random process has an 
important physical significance - it implies that the level of fluc¬ 
tuations at the output of an ideal integrator rises without bound 
due to their accumulation. 

Similar situations are frequently encountered in various fields of 
physics. An example is the well-known one-dimensional random 
walk of a particle (the Brownian motion) [14]. Here, the imaginary 
particle, on being equiprobably hit in two opposite directions, 
remains on the average in the same place, but its deviation from the 
mean position increases without bound in time. 
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The crossing problem. In statistical communication theory, the 
following problem related to the differential properties of random 
processes is of special interest. Suppose that realizations of some 
random process X(t) are sufficiently continuous functions of time. 
It is required to determine how frequently these realizations cross 
some fixed level x 0 . This problem naturally arises in, say, the 
noise-immunity analysis of communication systems subjected to 
fluctuation or random pulse noise. 

An event consisting in that a realization x(t) crosses the specified 
level x 0 in the upward direction can be called the upward crossing 
of the process X(t) at the level x 0 . 

Let us solve a very simple problem-we seek to find the average 
number of upward crossings per unit time. To this end, we mentally 
select on the £-axis a short interval of length or duration At. 
Assuming that the process X(t) is stationary and continuous, it is 
always possible to specify so small an interval At that no or only 
one upward crossing will occur within it. 

To begin with, we find the probability of the elementary event 
consisting in that in time At one upward crossing takes place. 
Obviously, it can occur if: 

(a) x(t)<x 0 and (b) x(t + At)> x 0 

Since 

x(t + At) x x ( t ) -I- x'At 

the condition (b) implies that 

x 0 -x'A t<x(t) 

Thus, a single upward crossing inside the interval At will take place, 
if the realization of the random process in that interval has 
a positive derivative, or an upward slope (x' ^ 0) and satisfies the 
inequality 

x 0 — x'At < x(t) < x 0 

The probability P of the above event is easy to find if we know 
the joint bivariate probability density p(x, x') of the realization and 
of its derivative, related to the same instant of time: 

OO *0 00 

P=$dx’ J p(x, x') dx = At fp(x 0 , x')x'dx' (7.28) 

o x 0 -x'At o 

The direct proportionality between the probability in (7.28) and 
the duration of the time interval At is an indication that the 
quantity n(x 0 ), the average number of upward crossings per second 



0 

An upward crossing 


x 



0 t t + \t 
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The normality of the 
derivative is utilized 


Quasi-frequency 


(or the crossing rate), can be defined by 

OO 

n(x 0 )= J P( x o> Ox'dx' ( 7 - 29 ) 

0 

Crossings of Gaussian processes. The average number of upward 
crossings is far simpler to find if the process X ( t ) is Gaussian. Then 
the instantaneous values of a realization and of its derivative 
observed at the same instants of time are statistically independent, 
that is, 

p(x 0 , x') = p(x 0 )p(x') (7.30) 

Also, the derivative, obtained as a result of linear operations on the 
original process, is likewise normal. On combining (7.29) and (7.30), 
we get 

n{x 0 ) = P( x o) j p(x')x'dx' (7.31) 

o 


Suppose that we know the autocorrelation function 
K x (t)=g 2 x R(t) 


of the process. Then the variance of the derivative will be 
c&= -g 2 R"( 0) 

Hence, the probability density of the derivative is 


p(x') = 


1 


]/2na x ]/ -R" (0) ^ j 2a *[“ R " (°)1 

By simple manipulations, we get 

j p (*') x' dx' = — 7 =^ Ox ]f~- R” (0) 
o ]/2n 

On substituting the above expression into (7.31), the average 
number of upward crossings per second for a stationary Gaussian 
process is found to be 


(7.32) 


n(x 0 ) = (1 /2n) ]/ — R"(0) exp ( — xl/lal) 


(7.33) 


The quasi-frequency of a stationary random process. In Sec. 7.1 it 
has been noted that some forms of random processes vary in time 
quasi-periodically. The numerical measure defining the rate of such 
variations is the quasi-frequency defined as the average number of 
zero-crossings per unit time. By virtue of Eq. (7.33), the quasi-fre¬ 
quency for a Gaussian process 
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«(0)=T-i/-k"(0) 

zk 


is wholly defined by the behaviour of the autocorrelation function 
at zero. Since 

- R"( 0 ) = 

and the variance of the derivative is expressed in terms of the 
one-sided power spectrum of the process X(t): 

OO 

CTx= J C0 2 F x (<a)d(0 

o 

then the quasi-frequency may be re-cast in a form equivalent to 
that of Eq. (7.34): 

n (0) = -f — [ J <b 2 Fjc(<») dco] 1/2 (7.35) 

ZTICJ X o 


Example 7.4. The quasi-frequency of a stationary Gaussian process 
with a band-limited low-frequency power spectrum (see Example 7.3). 
Here, 

OO 

J (o 2 F x ((o) dco = F 0 co 2 m /3 
0 

&X = y F 0 C0li m 

* 

On substituting the above expressions into Eq. (7.35), we get 

n (0) = (Olim/^TT j/3 =/lim/|/3 

The final result cannot be found directly. 


7.3 Narrowband Random Processes 

An extremely important role in telecommunications is played by 
a special class of random processes a salient feature of which is that 
their power spectrum has a sharply defined peak around a certain 
nonzero frequency. What follows is an analysis of the statistical 
properties of such narrowband random processes. The exposition is 
limited to the case of Gaussian processes most frequently 
encountered in practice. Also, it is for Gaussian processes that 
a number of important results can be obtained within the 
framework of correlation theory. 

The autocorrelation function of a narrowband random process. 


Quasi-frequency can 
only be determined 
for a differentiable 
random process 


A 

Solve Problem 9 
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F 



Wo 


The power spectrum 
of a narrowband ran¬ 
dom process 



The autocorrelation 
function of a narrow- 
band random process 


We consider a random process X(t) whose one-sided power 
spectrum F( go) is concentrated in the vicinity of an arbitrarily 
chosen frequency oe> 0 . 

By the W-K theorem, the autocorrelation function of the process 
in question is 

00 

K (x) = J F (cd) cos cot dco (7.36) 

0 

Let us mentally shift the power spectrum of the process from the 
vicinity of frequency co 0 into the vicinity of zero frequency by 
a change of variable, oo = co 0 + Q. Then Eq. (7.36) takes on the 
following form: 

00 

K(x)= J F (co 0 + Q) cos [(co 0 + Q) t] df2 (7.37) 

-C0 0 

Since we have assumed that the process X ( t ) is narrowband, its 
power spectrum F( 00 ) is vanishingly small at frequencies close to 
zero. Therefore, we may, to a high degree of accuracy, replace the 
lower integration limit in Eq. (7.37) with — 00 and re-write the 
autocorrelation function as 


K (x) = a (t) cos cq 0 t - b (t) sin co 0 t (7.38) 


where 

00 

a(x)— J F( co 0 + Q)cosQxd£2 

— 00 


and 

00 

b(x) = J F (ffl 0 + D) sin fit dQ 

— 00 

are slowly varying functions of the argument x. It is to be noted 
that a(x) is even and b(z) is odd about x. 

The autocorrelation function of a narrowband random process is 
especially simple and straightforward when the power spectrum 
F ( 00 ) is symmetrical about its centre frequency co 0 . Then b (x) = 0 
and 

K (x) = a (x) cos g) 0 t (7.39) 

The factor a(x) plays the role of an envelope which varies more 
slowly than the factor cosco 0 x. Frequently it is convenient to invoke 
a normalized envelope, p(x), for the autocorrelation function of 
a narrowband random process, by defining it as 

a( t) = ct5p(t) 
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Then, 


K{t) = axp(x)cosco 0 x 


(7.40) 


The envelope and the initial phase. The form of the 
autocorrelation function in (7.40) implies that the individual 
realizations of a narrowband random process are quasi-harmonic 
waves 

x{t)= U(t) cos [co 0 t+ cp(t)] (7-41) 

in which both the envelope U ( t ) and the initial phase cp (t) are 
random functions varying slowly (in scale of co 0 ). 

Let us write the realization defined in (7.41) as the sum of its 
in-phase and quadrature components (see Chap. 5): 

x(t) = A(t)cosco 0 t - B(t)sin(o 0 t (7.42) 

The two amplitudes, A(t) and B(t), are likewise slowly varying 
signals, and their variations grow progressively slower as the 
effective bandwidth Aco e fr decreases in comparison with the centre 
frequency co 0 . 

Consider a random process Y(t) which is the conjugate of the 
original random process X(t). Its realizations are found by the 
Hilbert transform: 

The assumption that the in-phase amplitude A ( t ) and the quadra¬ 
ture amplitude B(t) vary slowly enable us to write a fairly simple 
expression for a realization of the conjugate process by placing the 
slowly changing terms outside the Hilbert transform 

y(t) = A (t)sin co 0 t + B(t) cos co 0 t (7.43) 

Hence follow the expressions for the instantaneous values of 
a realization of the envelope 

U (t) = ]/x 2 +y 2 = ]/A 2 (t) + B 2 (f) (7.44) 

and of the initial phase 


(p(t) = arc tan 


B(t) 

A(t) 


(7.45) 


Statistical properties of the conjugate process. For a further 
analysis of the envelope and initial phase of a narrowband random 
process, we must establish the relation between the statistical 
characteristics of X(t) and Y(t). 

To begin with, it is to be noted that if x = 0, then y = 0 as well. 


x(t) 



A typical realization of 
a narrowband random 
process 
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Also, since X ( t ) is a Gaussian process, and the Hilbert 
transformation is a linear integral transformation, then the 
conjugate process Y(t) has the property of normality as well. 

As will be recalled, if S x ((o) is the spectrum of the realization x(t\ 
then the corresponding spectrum of the conjugate realization will 
be 

—jS x ((o)sgn (co) 

The magnitudes of S x ( co) and S y ( co) are the same, so the power 
spectra of X(t) and Y(t) are the same, too: 

W x (a)=W y (a) 

Hence we may conclude that the two processes have an identical 
autocorrelation function and that Y(t) is a stationary process: 

00 

K x (t) = K y (x) = J /- a (m)cos coidei 
o 


Finally, let us find the cross-correlation function 

K M- 7TT. . ~ 1 * x ( ( )*© 4t 

^ xy ( v - x ( t ) y(t + t) = — I - -&% 

I Jt J n t + T - % 


1 7 K x (%-t) ^ 


00 

4J 


K x (r\) 


drj 


which is the same as the Hilbert transform of the autocorrelation 
function of the process X (t). Similarly, it can be shown (this is left 
as an exercise for the reader) that 

K yx ( i)= -K xy ( T) 


Thus, 

00 

K x /t) = H [ K x (x)] = J F x (o) sin cox dco (7.46) 

o 

Interestingly, the function K xy (x) shows odd symmetry and 
vanishes at x = 0. Hence, the processes X ( t ) and Y(t) are statistically 
independent at the corresponding instants of time. Equation (7.46) 
can be re-cast in a more convenient form on making a change of 
variable, co = co 0 + Q. Then 
00 

K xy {x) = { (co 0 + Q) sin (co 0 4- £2) x dQ 
-co 0 

= a (x) sin co 0 x + b (x) cos co 0 ^ (7.47) 


where the functions a(x) and b(x) are defined as in (7.38). 
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Correlation properties of the in-phase and quadrature 
amplitudes. We seek to find and analyse the statistical 
characteristics of the envelope U ( t ) and of the initial phase cp ( t ). 
For this, it is convenient to replace the realizations x(t) and y(t) 
with the slowly varying realizations A(t) and B(t) which, on the 
basis of Eqs. (7.42) and (7.43), can be defined as 

A (t) = x (t) cos oo 0 1 + y (t) sin co 0 t 

(7.48) 

B(t)= — x(f)sinoo 0 t + y(t) cos (o 0 t 

The processes A(t) and B(t) are linearly related to the Gaussian 
processes X(t) and Y(t). Therefore, they, too, are Gaussian, and if 
x = y = 0, then A = B = 0, as well. 

Let us take the first line in Eqs. (7.48) and find the 
autocorrelation function of the process A ( t ). By simple 
trigonometry, we obtain 

Ka (t) = [x ( t ) cos co 0 t + y ( t ) sin co 0 t] [x (t + x) cos co 0 (t + x) 

+ y(t + x) sin co 0 (t + x)] 

= K x (x) cos co 0 x + K xy {x) sin co 0 x (7.49) 

Substituting for K x (t) and K X} {x) from (7.38) and (7.47) yields 
a very simple result: 

K a (x) = a (x) (7.50) 

Similarly, it is proved that 
K B (T) = a(x) 
and 

K AB (x) = b(T) (7.52) 

On setting x = 0 in (7.50) and (7.51), we obtain 

o 2 a = o%= J F( oo)d(Q = CTx (7.53) 

- 00 

Thus, the variances of the in-phase and quadrature amplitudes 
are equal to the variance of the original narrowband process X ( t ). 

The joint probability density of the envelope and of the initial 
phase. The advantages of the procedure in which the narrowband 
random process is replaced with its in-phase and quadrature 
components become obvious when we are to find the bivariate 
probability density p(U, cp). This characteristic, in turn, enables us 
to find the univariate probability densities of the envelope 

2K 

P(U)= I p(U, cp)dcp 
0 


(7.51) Wort Problem 10 


(7.54) 
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and of the initial phase 

P(<P) = J P(U, cp)dJ7 (7.55) 

0 


The instantaneous values of A(t) and B(t) form 
a two-dimensional Gaussian vector variable the two components of 
which are independent and have the same variance a*. Therefore, 
the bivariate probability density is 

p(A, B) = p(A)p(B) = ~p-exp [ - (A 2 + B 2 )/2ai] (7.56) 


In order to obtain the probability density p(U , cp), we should 
transform the random vector {A, B} into a new random vector 
{17, cp}: 

A = U cos cp, B = U sin cp (7.57) 

The Jacobian of such a transformation (see Eq. (6.24)) is 



cos cp 
sin cp 


— U sin cp 
U cos cp 


(7.58) 


Since in the new variables 


A 2 + B 2 = U 2 

it follows then that the expression for the sought-for bivariate 
probability density is 

p(U, cp) = (U/2na%)exp{ - U 2 /2o 2 x ) (7.59) 


The univariate phase distribution. Taking advantage of Eqs. 
(7.55) and (7.59), let us find the probability density of the initial 
phase: 

P(<P) = ^-J (U/a%)exp(— U 2 /2ux)dU 
2n o 

By a change of variable, z—U/< j x , we get 

P(<P.) = ] 2 exp (- z 2 /2)dz = A- (7.60) 

Thus, the initial phase of a narrowband random process is 
distributed uniformly in the interval from 0 to 2n. Physically, this 
means that all values of the initial phase of individually taken 
realizations are equally significant. 

The univariate envelope distribution. Since p(U , cp) is not an 

explicit function of cp, then, by virtue of Eq. (7.54), the probability 
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density of the envelope is 

p(U) = (U/ai)ex p(- U 2 /2ol) (7.61) 


It is advisable to change back to the nondimensional variable z = 
= U/cjx, for which 

p(z) = z exp ( - z 2 12) (7.62) 


The distribution of the instantaneous values of the envelope of 
a narrowband random process as defined by Eq. (7.61) or (7.62) is 
known as the Rayleigh distribution. The applicable plot in Fig. 7.1 
demonstrates that only some of the average values of the envelope 
(the orders of a x ) are most probable. On the other hand, it is very 
unlikely that the envelope can take on values either very close to 
zero or substantially exceeding the rms level, cr x , of the original 
process. 



0 M 2 3 


The Rayleigh distribu¬ 
tion 



Fig. 7.1 Plot of the probability density for a Rayleigh-distributed random 
variable (with the dimensionless argument z=U/<j x laid off as abscissa) 

By averaging on the basis of the distribution in (7.61), we can 
find the mean value of the envelope of a narrowband random 
process: 


mjj= U = J/7t/2a x = 1.253a x 

(7.63) 

and its variance: 


<j 2 u = U 2 — U 2 — (2 — k/2) g 2 = 0.429a x 

(7.64) 


The univariate probability density of the envelope enables us to 
solve many problems in the theory of narrow-band random 
processes, notably to find the probability of the envelope exceeding 
a definite specified level. 


A 

Solve Problem 11 
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Example 7.5. Let a narrowband normal process have a constant 
one-sided power spectrum F 0 = 1.5 x 10 -3 V 2 s in the frequency 
band from co m in = 10 5 s ~ 1 to co max = 1.02 x 10 5 s " 1 . Find the 
probability that the envelope of this process will exceed the level 
U 0 = 5V. 

From the statement of the problem, the effective band-width of 
the process is 

Aco e fr= 2 x 10 3 s “ 1 

Therefore, the variance is 

ax = F 0 Aco e ff = 3 V 2 

From the definition of the probability density, the sought-for 
quantity is 

P(U >U 0 )=] P (U)dU = exp (- U 2 / 2a 2 ) 

u o 

= exp (-25/6) = 0.0155 

It may be argued that the event considered in this example is 
a rather seldom occurrence. 


Rayleigh-distributed random variables arise in many physical and 
communication problems. The elegant derivation of Eq. (7.61) 
obtained by Rayleigh from entirely different assumptions can be 
found in a classic book [43]. 

The bivariate probability density of the envelope. For a proper 
insight into the behaviour of the envelope in time, it is essential to 
have a more detailed information as compared with that obtainable 
from the Rayleigh distribution. For example, if we wish to calculate 
the autocorrelation function of the envelope, we need to know the 
bivariate probability density p(U, U x ). (Here and elsewhere, U x = 
= U(t + x).) 

Let us take advantage of the fact that the in-phase and quadra¬ 
ture amplitudes of a narrowband normal process are low-frequency 
Gaussian signals having the same autocorrelation function 

K A (x) = K B (T) = G 2 x p(x) 


and the following bivariate densities [see (6.28)]: 


p(A, A x ) = 


2tuct 2 ]/1 - p 2 


exp 


A 2 + A 2 — 2pAA x 
2a 2 (1 - p 2 ) 


1 

27ua 2 }/l - p 2 



B 2 + B 2 - 2p BB X ~ 
2a 2 (l-p 2 ) _ 


P(B, B x ) = 
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If the power spectrum is symmetrical about the centre frequency 
G) 0 , such that b (t) = 0, the processes A(t) and B(t) are statistically 
independent, and so their joint quadrivariate probability density is 

p(A, A x , B , B x ) = p(A , A x )p(B, B x ) (7.65) 

Let us change from the in-phase and quadrature amplitudes to the 
envelope and the phase observed at different instants of time: 

A = U coscp; A x — U x coscp T 

(7.66) 

B=U sincp; B X =U X sincp x 
The Jacobian of the above transformation is 


D = 


cos cp 
0 

— U sin cp 
0 


0 sin cp 

cos cp T 0 

0 U cos cp 

— U x sin cp x 0 


0 

sin cp T 
0 

U x cos cp T 


= UU X 


(7.67) 


Using the above result, we can write the probability density (7.65) 
in terms of the new variables: 


p(U, U T , cp, cp x ) = 


uu x 

4n 2 ct*( 1 — p 2 ) 


x exp 


U 2 + U 2 Z - 2p UU x cos((p - cp T ) 1 

2ct 2 (1 -p 2 j 


(7.68) 


Now, in order to obtain the sought-for bivariate probability 
density of the envelope, we should integrate the right-hand side of 
Eq. (7.68) with respect to angular coordinates twice: 

271 2 71 

p(U, U x )= J d<p J d(p x p(U, U x , cp, cp T ) (7.69) 

0 0 


By applying a representation known from mathematics 

J 2!t 

— | exp (x coscp)dcp = 1 0 (x) 

where I 0 is a modified Bessel function of order zero, from 
Eqs. (7.68) and (7.69) we finally get 


uu x 

r u 2 +u 2 -j 

r puu x " 

^d-p 2 ) e p 

2a^(l-p 2 )J 

X—V 

<N 

CL 

1 

Td 
_1 

o 


(7.70) 



0 12 3 

The function 7 0 (jc) 


P(U, U x ) = 
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The probability density defined by Eq. (7.70) is sometimes called 
• the bivariate Rayleigh distribution. Interestingly, if the time shift 

The bivariate Rayleigh T substantially exceeds the correlation time T cor associated with the 
distribution function p(r), then p->0 and, since /„(0)= 1, we have 

p{U, U x )x(U/a 2 x )exp(- ^/loDiU-JaDexpi- U^/lcsi) (7.71) 

that is, p(U, U x ) tends towards the product of two univariate 
Rayleigh densities. 

The autocorrelation function of the envelope. By definition, 

Ku(x)=UU x -U 2 (7-72) 

On the basis of Eq. (7.63), the square of the mean of the envelope 
is 

U 2 = (k/2)o 2 x 

Therefore, the task reduces to calculating the mean value of the 
product UU X : 

UU X = Jdl/J dU x p(U. U X )UU X (7.73) 

o o 


A 

Solve Problem 12 


The evaluation of the integral in (7.73) involves a good deal of 
computational work because the bivariate probability density (7.70) 
expands into an infinite series of Laguerre polynomials [15]. 
Omitting the intervening manipulations, the final result can be 
written as 


K V (*) = y CT ' 


—+ £ 
4 „ = 2 


[(2n — 3)! !] 2 2 „ 
2 2 "(n !) 2 P 


(7.74) 


On writing the autocorrelation function as 


Ku(t) = gIjRuW 


we find from (7.74) the following expression for the correlation 
coefficient of the envelope: 


Ru( x) = 0.915p 2 (x) + 0.058 p 4 (x) + ... 


(7.75) 


In approximate calculations, it is legitimate to take the correla¬ 
tion coefficient of the envelope as being equal to the square of 
the envelope of the autocorrelation function of the narrowband 
signal. 


Example 7.6. Let it be known that the autocorrelation function (in 
V 2 ) of a random process is 

K x ( t) = 0.5exp( - 10 4 |t |)cos2tt x 10 6 x 
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Since the high-frequency component has a period of 10“ 6 s, and 
the amplitude coefficient changes in the meantime by a factor of 
only exp( — 10“ 2 ) = 0.99, the random process in question may be 
taken as a real narrowband process with a centre frequency f 0 = 
= 1 MHz. Retaining only the first term in the series (7.75) and 
replacing the coefficient 0.915 approximately with unity, the 
correlation coefficient of the envelope is found to be 

R[/W^ ex P( - 2 x 10 4 1 x |) 

The variance of the envelope is 
= 0.429a 2 = 0.2145 V 2 

Hence, the autocorrelation function of the envelope is 
K v ( x) = 0.1963exp( - 2 x 10 4 | x |) 


The correlation time of the envelope 

00 

x C or = j R(y(x)dx = 0.5 x 10“ 4 s 
o 

is equal to 50 periods of the harmonic wave of frequency / 0 . 
Finally, the one-sided power spectrum of the envelope (see Example 
7.1), whose dimension is V 2 s, 

2.73 x 10 3 

Fl/(CO)= 4xl0 8 W 

is concentrated in the low-frequency region. 


The envelope of the sum of a harmonic signal and a narrowband 

Gaussian noise. In communications engineering, it is often 
important to know the statistical regularities of the signal observed 
at the output of a frequency-selective device, such as a tuned 
amplifier. Here, the Gaussian fluctuation noise at central frequency 
(D 0 equal to the resonance frequency of the system is present along 
with a deterministic signal U m cos(o 0 t of a known amplitude U m . 
If the message transmitted over the communication system is 
embedded in the envelope of the output wave, as is the case with 
amplitude modulation, it is important to learn the extent of signal 
corruption due to noise. 

The simplest problem is to find the univariate probability density 
for the envelope of the aggregate waveform. Assuming that the 
signal is 

s(t) = U m COS(O 0 t 

and the fluctuation noise is 

n(t) = A(t) cos co 0 t — B(t) sin co 0 t 

we may write the following expression for a realization of the 
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aggregate process x(t)\ 

x(t) = s(t) + n(t) = [ U m + -4(0] cos (0 0 t - B{t) sin co 0 t 

This is a narrowband process, therefore its realization may be 
written in terms of the slowly changing envelope U {t) and of the 
initial phase cp (t): 

x(t)=U ( t ) cos [cd 0 ( t ) + cp (0] 

Obviously, there is a relation between the pairs { A , B} and {U, 
cp] such that 

A = U coscp - U m 

B=U sincp (7.76) 


It is an easy matter to verify that the Jacobian D of the above 
transformation is equal to U. In consequence, since the bivariate 
probability density is 


p(A, B ) = — l — exp [ — (A 2 + B 2 )/2o%] 
ZTlCJx 

then in the new variables 


P(U, cp) = 


U 


2kg 2 


exp - 


U 2 + Uj-2UU m cos(p 
2g 2 x 


(7.77) 


Now, in order to find the univariate probability density of the 
envelope, we should integrate the right-hand side of Eq. (7.77) with 
respect to the angular coordinate: 

271 

p(U)= S P(U, <P)dq> 

0 


0 

The Rice distribution 


As a result, we get 

P(U) = (U/g 2 x ) Q x p [ — (U 2 + U 2 m )/ 2ai] I 0 (UUJg 2 ) (7.78) 

Equation (7.78) expresses the distribution law known in,„ 
communication theory as the Rice distribution. It is to be noted that 
for U m = 0, that is, in the absence of a deterministic signal, the Rice 
distribution goes over into the Rayleigh distribution automatically. 

Figure 7.2 shows the probability density function of 
a Rice-distributed random variable for several values of the ratio 
a= Um/<J X . 

Interestingly, if the amplitude of the deterministic signal is 
substantially greater than the rms noise level, that is, if I7 m /a x »l, 
then for U»U m we may use the asymptotic representation for 
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The curve in colour 
answers the Rayleigh 
distribution 


Fig. 7.2 Probability density of a Rice-distributed random variable 


modified Bessel functions with a large argument: 

, ,„r, ,_ 2 ,~ exp (C/17w/aj) _ (j x exp(UUJu x ) 
1 q\U U m/G x)~ / -— ~ /— 

|/2jt(l7lVa|) V^ u 

On substituting in (7.78), we get 

L—exp [ — (l/ — Um) 2 / 2ax] 

\ 2rca v 


(7.79) 


That is, the envelope of the resultant signal is now an 
approximately Gaussian variable of variance cr* and of mean value 

U m - 

For practical purposes it is legitimate to assume that even at 
Umhx = 3 the envelope of a narrowband signal is normalized. It is 
useful to recall that the Rayleigh-distributed envelope of pure noise 
has a variance of 0.429cjx. Thus, the increase in the amplitude of 
the deterministic harmonic signal more than doubles the variance 
of the envelope. Yet, the relative fluctuations of the_envelope 
decrease. To demonstrate, for pure noise the ratio gjj/U, which 
can serve as a convenient numerical measure of fluctuations, is 
0.523. In the case of a large deterministic signal, <Ju/U = o x /U m , 
tending to zero as U m increases. 


A typical realization 
of the envelope of a 
narrowband noise 


l 

o 

and a process which 
is the sum of a harmo¬ 
nic signal and narrow- 
band noise 



Note variations in the 
mean and the variance 
due to the harmonic 
signal 


u 




Summary 

OO The random spectrum of the individual realizations of a stationary random process is 
delta-correlated and has mean value zero at all frequencies. 

OO The Fourier transform of the autocorrelation function of a stationary random process 
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is called the power spectrum. As the power spectrum grows wider, the realizations of 
the random process become increasingly more random. 

For a random process to be differentiable, it is essential that there should exist the 
second derivative of the autocorrelation function, with the argument being equal to 
zero. 

The instantaneous values of realizations of a random process and of its derivative 
observed at corresponding instants of time are uncorrelated. 

The realizations of a random process appearing at the output of an ideal integrator 
form a nonstationary random process even when the input process is stationary. 
OO* In the general case, the realizations of a narrowband random process are quasi¬ 
harmonic waves randomly modulated in amplitude and phase angle. 

The autocorrelation function of a narrowband random process is the product of 
a rapidly changing component and a slowly changing component. 

*0$ A narrowband random process and its Hilbert transform observed at corresponding 
instants of time are uncorrelated. 

The envelope of a narrowband Gaussian random process is Rayleigh-distributed; the 
initial phase of the process is uniformly distributed. 

The autocorrelation function of the envelope of a narrowband process is 
approximately equal to the square of the envelope of the autocorrelation function of 
the process itself. 

00 The envelope of the sum of a harmonic signal and of a narrowband Gaussian noise 
for which the centre frequency of the power spectrum is the same as the signal fre¬ 
quency is distributed by the Rice law. 

00 At large values of the signal-to-noise ratio, the envelope is normalized. 


Review Questions 

1. A random process is studied within the framework of correlation theory. What is the 
meaning of the statement? 

2. State the Wiener-Khinchin (W-K) theorem. 

3. List the principal properties of the power spectrum of a stationary random process. 

4. Define the concept of one-sided power spectrum. If the power spectrum of a stationary 
random process is known, how can you find its variance? 

5. Why is it that random processes resembling white noise are called delta-correlated? 
What are the basic properties of white noise? In what cases may a real random process 
be approximated with white noise? 

6. Define the concept of convergence in probability. 

7. List the salient properties of nondifferentiable random processes. 

8. How does one find the variance, the autocorrelation function and the power spectrum of 
the derivative of a stationary random process? 

9. Define the notion of an upslope (positive-going) crossing of a random process. 

10. What is the quasi-frequency of a stationary random process? 

11. Draw an approximate plot for a realization of a narrowband random process. 

12. List the basic properties of the in-phase and quadrature amplitudes of a narrowband 
random process. 
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13. Why is it that the Hilbert transform of a Gaussian random process retains the property 
of normality? 

14. Draw the typical waveform of a Rayleigh-distributed random signal. 

15. Draw plots of the Rice distribution for several values of the signal-to-noise ratio. 


Problems 


1. Calculate the power spectrum of 
a stationary random process for which the 
autocorrelation function is 

cr 2 (l - | t|AoX ! 

0, in 


following plot: 


K( x) = 


I ^ t 0 

\ > t 0 
spectrum 


2. Find the power 
a stationary random process for which the 
autocorrelation function is 

K(t) = a 2 exp( — (3 2 x 2 /2)cosco 0 x 

3. The one-sided power spectrum of 
a stationary random process X (t) is defined 
by 

F x (f) = A (f/f 0 ) exp ( -f/f 0 ) 

where A and / 0 are constants. Determine the 
autocorrelation function of the process. 

4. A stationary random process has an 
effective bandwidth of 1.5 MHz. The 
maximum value of the ^one-sided power 
spectrum is 0.3 x 10“ 12 V 2 Hz -1 . De¬ 
termine the variance of the process. 

5. Find the correlation time for 
a stationary random process whose 
autocorrelation function has the form 

K (x) = a 2 exp (— a | x | ) 

6. Assuming that the air temperature 
over a month is a realization of a stationary 
random process, estimate the correlation 
time. 

7. Find the variance for the derivative of 
a random process whose autocorrelation 
function has the form 

K(t) = a 2 (l -f a| x |)exp( — a| x |) 

8. A stationary random process has 
a power spectrum represented by the 



Aw 


W 

Ac o 











W 0 



of 

1 



1 

(!) 


— <A>0 


u>0 


F*(co) = 


Prove that this random process is 
differentiable, and find the variance of its 
derivative. 

9. The quasi-frequency of a random 
process of variance 8 V 2 is 0.5 MHz. 
Determine the variance of its derivative. 

10. A stationary random process X(t) has 
the power spectrum 

F 0 for cOi < co < 0 ) 2 
0 for (o < co l9 (o>co 2 

The realizations of the process are defined 
by 

x(t) = A(t)cos co 0 t- B(t )sin co 0 t 
where 

co 0 = (co 2 — 00i)/2 

Find its autocorrelation functions Ka(t) and 
Kb(t) and its cross-correlation function 
Kab(t). 

11. Find the mean and the variance of the 
envelope of a narrowband normal random 
process for which the autocorrelation 
function is 

K x (t)= 25exp(-4 x 10 6 x 2 )cosl0 9 x 

12. A narrowband normal random 
process X ( t ) has the autocorrelation 
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function 

X x (x) = a 2 exp( - Px 2 /2)cosco 0 x 

Find the autocorrelation function and the 
power spectrum for the envelope of the 
process. 


Advanced Problems 

13. Analyse the autocorrelation function 
of a process recognized as a random 
telegraph signal. Its realizations are 
discontinuous functions which equiprobably 
take on only two values: +a and —a: 








- \-a 

t 







-a 


At random instants of time, each realization 
changes its sign abruptly. The probability 
that over a time T the sign will be changed 
n times obeys the Poisson law: 

P T (n) = cxpi — XT) 

n! 

where A, is the parameter defining the time 
rate of change of the process. 

14. A narrowband normal random 

process X (t) has the autocorrelation 
function 

K x (x) = ct 2 p (x) cosco 0 x 

Prove that the square of its envelope has the 
autocorrelation function 

Kui (t) = 4a 2 p 2 (x) 

15. A narrowband normal random 

process has the autocorrelation function 
defined in Problem 14. Find the univariate 
probability density for the instantaneous fre¬ 
quency of the process. 


2. Circuits 


Chapter 8 

Response of Linear Stationary 
Systems to Deterministic Signals 

Part One of this book has dealt with the basics of signal theory. 

It has been stressed that signals can be the objects of a theoretical 
study only after we introduce suitable mathematical models. This is 
also true of the structures used to process, transform or transmit 
signals. These structures are extremely diverse in both their internal 
arrangement and in their external characteristics. So that they can 
be compared and classified, we should above all formulate 
a number of basic notions. 

8.1 Physical Systems 

and Their Mathematical Models 

However different communication circuits may be, each will 
always have an input to reqeive the original signals, and an output 
to deliver the transformed signals for further use. As a rule, this is 
illustrated by a block diagram of the “black box” type. 

System operators. In the simplest case, both the input signal 
win (0 and the output signal w ou t(0> frequently called the response of u in 
a system, are individual functions of time. In the more general case, —^ 

the input signal is represented as an m-dimensional or vector 
variable 

^in(0 = { w in,l(0> ^in,2(0? •••> w in,m(0} 

and the output signal as an w-dimensional or vector variable: 

^out(0 = { w out,l(0> w out,2(0> •••> M out,n(0} $ 

The relation between U{ n and U out can be specified by means of ^ system operator 
a system operator T whose action on results in U out 



U 0 Ut (t)=TU in (t) 


( 8 . 1 ) 
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Example 8.1. Suppose that a system transforms a one-dimensional 
signal such that 

1 

U in 

Wout(0 = 1 ^ c\.U'm{t)/&t 

*15 


In this case the system operator may be written as 



T= 15 d/dt 

From the above expression we can identify the system as consisting 
of a scaler (an ideal amplifier) and a differentiator, as shown in the 
accompanying block diagram. 

d/df 


\ 

f W 0 ut 


To make the problem completely defined, it is also necessary to 

specify the domain Din in some functional (for example, Hilbert) 

space, which is called the domain of eligible input signals. In the 
simplest case it is specified by stating the kind of eligible input 
signals which may be continuous or discrete, deterministic or 
random. Similarly we define the domain of eligible output signals , 
Dout- 

The combination of an applicable system operator T and the two 
eligible signal domains, D in and D ou t, will be further referred as 

® a mathematical model of the physical system involved, and 

A mathematical model communication systems will be classed on the basis of the most 

of a physical system significant properties of their mathematical models. 

More specifically, this Chapter will be solely concerned with 
systems acted upon by analog signals defined by both continuous 
and discontinuous functions of time. The transformation of discrete 
(and, especially, digital) signals by linear systems will be examined 
in Chap. 15. 

Stationary and nonstationary systems. A system is said to be 
stationary, if its response is independent of the time at which it 
accepts the input signal. If Tis the operator of a stationary system, 
then from the equality 

U out(t) = TU in(t) ( 8 - 2 ) 

it follows that 

Uout(t + t 0 )=TU in (t±t 0 ) (8*3) 

for any value of t 0 . Also, systems are called stationary if their 
parameters remain constant in time, or time-invariant. 

Otherwise a system is called nonstationary (a time-variant or 
parametric system). 

The two classes of systems are widely used in telecommunications 
and will be the subject of the subsequent discussion. It should be 
pointed out, however, that a theoretical study of nonstationary 
systems is ordinarily a far more complicated task. 
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Linear and nonlinear systems. A most important principle 
underlying the classification of communication systems is that 
various systems generally respond differently to a sum of input 
signals. If the system operator is such that 


T(U in, 1 + U in, 2 ) — TU in, 1 + TU in, 2 

T(aU in) = aTU in (8.4) 

_ The principle of 

superposition 

where a is an arbitrary number, then the system is linear. The 
conditions in (8.4) define the fundamental superposition principle. 



M out 


Example 8.2. A system transforms the input signal in such a way 
that 


M out (0 — 



Win (t) 


It can be verified by inspection that the conditions defined in (8.4) 
are satisfied. Thus, the system in question is linear. 

Example 8.3. Suppose that a system is an ideal squarer operating in 
accordance with the algorithm 


Wout(t) — wfn(t) 

By applying a sum of two input signals, Mi n ,! + wi n , 2 > we obtain the 
following response: 


WoutW — W? n , 1 T- 2 l/in, iMin,2 + w ?n , 2 

The presence of the cross-product 2ui n , 1 Mi n , 2 is an indication that 
tht system is nonlinear. 


Strictly speaking, all physical systems dealt with in 
telecommunications are to a varying degree nonlinear. However, 
there is a class of systems for which linear models yield a fairly 
accurate description. For example, we can practically always ignore 
the nonlinear behaviour of ordinary resistors, capacitors and some 
inductors. As will be shown later, linear systems are remarkable in 
that for them we can, at least theoretically, solve any problem 
involving the transformation of an input signal. 

Nonlinear circuits usually contain diodes and transistors. Their 
nonlinearity manifests itself in that their current-voltage 
characteristics strongly differ from linear relations. 

Although the theory of nonlinear systems is, as a rule, very 
complicated, and far from any results can be deduced analytically, 
it is with the aid of nonlinear elements that the most important 
transformations are performed on communication signals. A theory 
of the simplest nonlinear systems is set forth in Chap. 11. 
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ICs are examples of 
lumped-constant sys¬ 
tems 



A waveguide is an 
example of a distribu¬ 
ted-constant system 


Part Two. Circuits 

Lumped-constant and distributed-constant systems. Another 
principle for classifying the elements, devices and systems used in 
telecommunications is by comparing the physical size of a system 
with the wavelength applied to its input. If the characteristic 
dimension of a system (say, the maximum length of the wires in an 
electric circuit) is substantially smaller than the wavelength used, we 
have a lumped-constant system. 

In a lumped-constant electric circuit, it is always possible to 
single out physical regions within which the energy of the electric 
field, as in capacitors, or the energy of a magnetic field, as in 
inductors, is concentrated (or lumped). The properties of 
lumped-constant circuits are independent of the configuration of 
connecting wires, therefore it is customary to describe such circuits 
by use of their abstract models called schematic circuit diagrams. 

In telecommunications, lumped-constant circuits are used at fre¬ 
quencies up to several hundred megahertz. Their analysis and 
synthesis are carried out by invoking the Kirchhoff laws. 

At microwave frequencies, the physical size of most devices is 
comparable with the wavelength used. Because of this, it is essential 
to consider the effect of the finite time it takes a signal to propagate 
around the system. Ordinary electric circuits cannot be used at 
microwave frequencies, and they give way to what are called 
distributed-constant systems (also known as waveguide systems). 
Instead of connecting wires, use is made of lengths of metal tubes, 
called waveguides, and instead of 1C tuned circuits resort is made 
to their distributed-constant counterparts known as cavity 
resonators or resonant cavities. As a rule, the theory, analysis and 
synthesis of distributed-constant systems are fairly complex and are 
the subject-matter of separate disciplines. 

To conclude our brief overview of system classification, we shall 
concentrate on lumped-constant linear stationary systems-the 
simplest type of all. The most typical examples are linear electric 
circuits whose properties must be known to the student from the 
previous courses. To them we may add, however, any linear 
physical devices and systems whose properties remain inchanged in 
time and whose size is small as compared with the wavelength used. 

8.2 The Impulse, Step 

and Frequency Responses of Linear Stationary Systems 

Linear systems have a remarkable property-they obey the 
superposition principle. This offers a direct approach to 
a systematic analysis of system responses to a variety of input 
signals, also called driving or forcing functions , or excitations. Using 
the dynamic representation of signals set forth in Chap. 1, we can 
resolve input signals into sums of elementary pulses. If, now, we 
find, in one way or another, the response of a system to any 
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elementary excitations, the final step in solving the problem will be 
simply to combine the individual responses. 

This form of analysis is based on the representation of signal and 
system properties in the time domain. It is equally possible and, 
sometimes, even more convenient to use their analysis in the fre¬ 
quency domain when signals are specified by giving their Fourier 
series expansion or integrals. Then the system properties can be 
represented by their frequency characteristics which define how the 
elementary harmonic signals are transformed. 

The impulse response. As will be recalled, the dynamic 
representation of signals uses any one of two elementary 
excitations. These are the unit step input and the unit impulse input 
or delta function. Let us first turn to the integral representation of 
a signal by means of the delta funcion. 

Let a linear stationary system be described by its operator T. For 
simplicity we assume that the input and output signals are 
one-dimensional. By definition, the impulse response of a system is 
the function h(t) which is the system response to a forcing function 
of the form 5(t). This implies that h(t) satisfies the following 
equation: 


h(t) = T5(t) (8.5) 


In mathematics, the 
impulse response is 
known as the Green 
function of the opera¬ 
tor in question 


Since the system is stationary, a similar equation will hold when 
the input excitation is translated in time through an arbitrary 
interval t 0 : 

h(t-t 0 )=T8(t-t 0 ) % (8.6) 

It must be clearly realized that the impulse response as well as 
the forcing delta-function are outcomes of a reasonable idealization. 
From a physical point of view, the impulse response approximates 
the response of a system to a unit-area impulse forcing function of 
an arbitrary waveform, provided that the duration of the input 
signal is negligible in comparison with the system’s transient time, 
that is, the time it takes for the system to reach a steady state. 

The Duhamel superposition integral. An extremely important 
role that the impulse response plays in the theory of linear 
stationary systems stems from the fact that knowledge of h(t) 
enables us to solve formally any problem concerned with the 
passage of a deterministic signal through such a system. Indeed, as 
has been demonstrated in Chap. 1, the input signal can always be 
represented as 
00 

«in(t)= 1 Min(T)5(f-T)dt 

— 00 


The physical signifi¬ 
cance of the impulse 
response 
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The respective response is then 

00 

Uoudt)=TuiS)=T J K in (x)8(t-x)dx (8.7) 

— 00 

Now we recall that an integral is the limit of a sum, so the linear 
operator T may, on the basis of the superposition principle, be 
included under the integral. Also, the operator T “operates” only on 
the terms dependent on the current time t, but not on the 
integration variable x. Therefore, from Eq. (8.7) it follows that 
oo 

u out(t) = J Uin(x) T5(t — x)dx 

— 00 

or, finally 


00 , 

w out(0 = j Min(x) /z(t — x) dx (8.8) 

— oo 


▲ 

Work Problem 1 


The result in Eq. (8.8), of fundamental significance in the theory of 
linear systems, is called the Duhamel superposition integral From 
inspection of Eq. (8.8) it is seen that the output signal from a linear 
stationary system is the convolution of two functions - the input 
signal (excitation) and the impulse response. Obviously, we may 
re-write Eq. (8.8) as 
00 

Mout(t)= 1 u in (t-x)h(x)dx (8.9) 

— 00 

A major advantage of the analysis based on the Duhamel 
superposition integral is that, once the impulse response h(t) is 
found, we can reduce the subsequent computational steps to 
completely formalized operations. Even if the integrals in (8.8) and 
(8.9) cannot be found analytically, it is always possible to analyse 
them numerically on a computer. 


Example 8.4. Suppose that a linear stationary system, whose 
internal arrangement is immaterial, has an impulse response which is 
a rectangular video pulse of finite duration T and of amplitude A 0 , 
occurring at t = 0: 



t< 0 
0 <t<T 
t> T 


_ 

0 T 


t 


Find the response of the system, if the excitation is the step input {to 
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0 T 


t 


he defined later): 

Win (t) = U 0 o(t) 

In using the Duhamel superposition integral in (8.8), we note that 
the output signal varies according as the time t exceeds or not the 
duration of the impulse response. For 0 <t<T, we have 

t 

Wout (t) = A 0 U 0 J dx = A 0 U 0 t 
o 

On the other hand, if t > T, then for x > T the impulse function 
h(t — x) vanishes, and so 
T 

Mout(f) = A 0 U 0 I dx = A 0 U 0 T 
o 

The response thus found is plotted as a piecewise-linear function. 


Generalization to the multidimensional (vector) case. It has been 
assumed that both the forcing function (excitation) and the output 
signal (response) are one-dimensional. In the more general case of 
a system with m inputs and n outputs, we need to introduce the 
partial impulse responses hy(t) (i = 1, 2, ..., n ; j = 1, 2, ..., m), each 
of which represents the response at the ith output to the delta- 
function excitation which is applied to the yth input. The set of 
functions hy(t) forms the impulse-response matrix 

Ki h 12 ••• h im 





( 8 . 10 ) 


In the multidimensional (vector) case, the Duhamel superposition 
integral takes the form 



Uout(t)= J h(t t) L/j n (t) dx (8.11) 

— 00 

where U\ n is an m-dimensional vector, and U out is an n-dimensional 
vector. 

The condition for physical realizability. Whatever the actual form 
of the impulse response of a physically realizable system, the 
following important principle must always be satisfied: A physical 
system cannot give an output in advance of the input signal. 

This principle imposes a very simple constraint on the form of 
feasible impulse responses: 

h(t) = 0 for t< 0 (8.12) 



Examples of impulse 
responses for real¬ 
izable systems 


8-728 
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This condition is met, for example, by the impulse response of the 
system considered in Example 8.4. 

It is easy to see that for a physically realizable system the upper 
limit in the Duhamel superposition integral must be replaced with 
the current value of time: 


t 

M out(0 = J Ujn( t) (t x) dx 

— 00 


(8.13) 


Equation (8.11) has a clear physical significance: A linear 
stationary system performs the operation of weighted summation 
over all instantaneous excitation values applied to the input and 
existing in the “past” for - oo < x < t. The weighting function here 
is the impulse response of the system. Importantly, under no 
circumstances can a physically realizable system operate on the 
information embodied in the “future” values of the input. 

The step response. Let the forcing function (excitation) acting at 
the input of a linear stationary system be a unit step input 
represented by the Heaviside unit function a(t). The response of the 
system to this form of excitation 

g(t)=Tcj(t) (8- 14 ) 

is called the step response of the system. Because the system in 

question is stationary, the step response is invariant under the time 

translation: 

g(t — t 0 ) = Ta{t - t 0 ) 

What has earlier been said about the realizability of a system 
fully applies to a system driven by a unit step input as well as by 
a unit impulse. Therefore, the step response of a realizable system is 
nonzero only for t>0, whereas 

g(t ) = 0 for t < 0 (8.15) 

There is a close relation between the impulse response and the 
step response. To demonstrate, since 8(t) = da/df, then, by virtue of 
(8.5), 


h(t)=T 



The differentiation operator d/dt and the linear stationary operator 
T may be interchanged, so 




(8.16) 
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or 


g(t)= j h(Qd^ 


(8.17) 


Example 8.5. Find the step response of the linear system from 
Example 8.4. 

Since here 

h(t) = A 0 a{t)-A 0 o{t- T) 


then, on the basis of Eq. (8.17), 

r 


g(t) = 


0 for t < 0 
< A 0 t for 0 <t<T 
A 0 T for t > T 


Thus, the system being at rest at £<0 will change to a new 
stationary state in response to a unit step input during the time 
equal to the duration of the impulse response. 


Taking advantage of Eq. (1.4) used in the dynamic representation 
of signals and proceeding along the same lines as in deriving 
Eq. (8.8), we obtain one more form for the Duhamel superposition 
integral: 

t 

Wout (t) = U[ n {0)g{t) + J {dui n /dT)g{t - x)dx (8.18) 

o 

The frequency response. In mathematical analysis of systems, it is 
important to find such input signals (excitations) which, on being 
operated upon by a system, remain unchanged to within a certain 
numerical factor. If the equality 

w out(0 = Tu{ n (t) = Xu[ n (t) (8.19) 

is satisfied, then U{ n (t) is called the eigenfunction of the operator T, 

and the number X (complex in the general case) is called its Eigenfunction and 

eigenvalue. eigenvalue 

Let us show that the complex signal u{ n (t) = exp (/cot) is the eigen¬ 
function of a linear stationary system for any co. To this end, we 
take advantage of the Duhamel superposition integral as defined in 
(8.9) and obtain 

00 

Uout (t) = J exp[/co(t — x)]/z(x)dx 

— 00 

00 

= [ | h (x) exp (— jrax) dx] exp (/cot) (8.20) 

— oo 


8 * 
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Hence, the eigenvalue is the complex number 


# 00 

The frequency re- K{jco) = j h(t) exp ( —jcot) dt 

sponse of a system _0 ° 


( 8 . 21 ) 


called the frequency response of a system*. 

Equation (8.31) establishes a fundamental fact: The frequency 
response and the impulse response of a linear stationary system are 
related by a Fourier transform pair. Therefore, if we know K (/co), we 
can always determine the impulse response of the system 


00 



— 00 


K (/co) exp (/cot) dco 


( 8 . 22 ) 


Analysis in the time 
domain and the fre¬ 
quency domain 


This has led us to a crucial point in the theory we are concerned 
with: Any linear stationary system may be analysed either in the 
time domain by use of its impulse and step responses, or in the fre¬ 
quency domain on the basis of its frequency response. Each is as 
good as the other one, and the choice is a matter of convenience in 
obtaining initial specifications and calculations. 

In conclusion, it should be noted that the frequency properties of 
a linear system having m inputs and n outputs can be described by 
the frequency response matrix 


K(jco) = 



Kll ■ 

.. K m 

K ni 

K n2 .. 

■ • Knm 


(8.23) 


The relation between the matrices h and K is similar to that defined 
by Eqs. (8.21) and (8.22). 

The amplitude (or magnitude) response and the phase response. 
The frequency response K{jco) is simple to interpret: If the 


* The alternative terms are the complex response or.the complex transfer 
function (J. Brown and E.V.D. Glazier, Telecommunications. London: 
Chapman and Hall, 1974), the system or response function [20], the transfer 
response (Handbook of Automation , Computation and Control. Ed. Eu. 
M. Grabbe, S. Ramo, and D.E. Wooldridge. New York: John Wiley and 
Sons, Inc., 1958), etc -Translator's note. 
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excitation is a harmonic signal of known frequency co and of 
complex amplitude Um, then the complex amplitude of the output 
signal will be 

Uout = K (/©) U in (8.24) 

Frequently, especially in engineering calculations, the frequency 
response is written in the exponential form: 

K (/co) = \K(j(o)\ expjcp/c (co) (8.25) 


Uout 



The two real functions involved have each a special name. Thus, 
I K (/co) | is called the amplitude (or magnitude) response , and cpA: (co) is 
called the phase response of the system. There is a variety of 
instruments designed to measure and record the two functions of 
various electric and electronic circuits and devices in any frequency 
range. 

The constraints imposed on the frequency response. Not just any 
function K(jco) may be the frequency response of a realizable 
system. The simplest constraint arises because the impulse response 
h(t) must be real. By virtue of the properties of Fourier transforms 
(see Chap. 2) this means that 

K (/co) = K*( — yco) (8.26) 


As follows from Eq. (8.26), the modulus of the frequency response 
(or the amplitude response) is an even function of frequency, 
whereas the phase angle (that is, the phase response) is an odd 
function of frequency. 

It is far more difficult to say what the frequency response must 
be like for the realizability condition, (8.12) or (8.15), to be satisfied. 
The answer is given by the Paley-Wiener criterion which we will 
give without proof. Tfie Paley-Wiener criterion states that 
a necessary and sufficient condition for an amplitude response to be 
realizable is that 


The properties of the 
amplitude and phase 
response 


The Paley-Wiener cri¬ 
terion 


|log|K(/co)l 
1 + co 2 


dco < + oo 


(8.27) 


Let us consider a specific example which illustrates the relation 
between K{jco) and h{t). 


Example 8.6. Suppose that a linear stationary system behaves like 
an ideal low-pass filter. This implies that its frequency response is 
specified by the following set of equalities: 

' 0, C0< -ffllim 
K 0 , COlim < CO < C01i m 
, 0, © > COlim 


K(j(o) = 
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On the basis of Eq. (8.20), the impulse response of such a filter 

is 


G>lim 

Kn P .... i^o^lim sinCDlim t (R 

M<>-J -;-' 1 

— ® lim 

The symmetry of the function about t = 0 is an indication that an 
ideal low-pass filter is not physically realizable. In fact, the same 
conclusion could be drawn directly on the basis of the 
Paley-Wiener criterion. This is because the integral in (8.27) turns 
out to be divergent for any system whose amplitude re¬ 
sponse function vanishes within some finite interval on the 

frequency axis. u . 

Although an ideal low-pass filter is not physically realizable, this 
model is successfully used to approximately describe the properties 
of filters, assuming that the function K{jco) contains a phase factor 
which is a linear function of frequency: 


r 0, CD < - CDlim 

K (;co) = < K 0 exp ( - j(Ot 0 ), - COlim < CD < CDlim 

k 0, CD > CDlim 

As can be readily verified, here 
^0®lim sinCDlirn(^ ^o) 

^ n ©lim(t-to) 


(8.29) 


The parameter t 0 , equal to the slope of the phase response, defines 
the time delay for the time shift of the maximum of h(t). Obviously, 
the accuracy with which this model can represent the properties ot 
a realizable system improves as t 0 increases in value. _ 





8.3 Linear Dynamic Systems 

The heading refers to linear systems which have the following 
property: the output signal is determined not only by the value of 
the input signal at any particular instant of time at present, but also 
by the entire “past history” of the input process. In other words, 
a linear dynamic system has “memory” which governs the manner 
in which the input signal is transformed. 

Systems described by differential equations. Of the many possible 
dynamic systems, those of primary concern to communication 
theory are systems which can be described by differential equations. 
In the most general case, these are systems for which the input-out- 
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put relations are established by the following differential equation: 


Qn~ 


d w G ut 
d t n 


+ a n _ 


U ou t , , dliout 

+ ... 4- a 1 —--b ci 0 Uout 


, d m i/in , 

— Dm cL m ' 1 


dt "" 1 
d m ~ 1 


dt” 


dt 

liin u dt/in , 

— -b ... + b l — -b b 0 Uin 

dt 


(8.30) 


Precisely this form of dynamic relation exists between the 
instantaneous values of the input and output signals in 
a lumped-constant electric circuit. If the circuit is linear and 
stationary, then all coefficients a 0 , a l9 ..., a n and b 0 , b l9 ..., b n are 
constant real numbers. 

Suppose that the input signal ui n (t) is fixed. Then the right-hand 
side of Eq. (8.30), which can arbitrarily be designated as f(t\ is 
a known function. Then the analysis of the system’s behaviour 
reduces to the well-known mathematical problem of solving an 
nth-order linear differential equation with constant coefficients: 

d w 0 ut d” 1 n 0 ut r .. 

a n dt n dt n-T~- + - “out =/W ( 8 * 31 ) 


The order n of the equation is called the order of the dynamic 
system involved. 

Consider several examples of dynamic systems and the 
corresponding differential equations. 


The order of a dyna¬ 
mic system 



First-order systems are 
also called pure-delay 
(or lag) elements 


* 

Example 8.7. Consider an RC-network in the form of an L-section 
two-port driven by a source of emf v\ n (t). The output signal is the 
voltage across the capacitor. 

Since the current in the circuit is 

i ( t ) = C dvoux/dt 

then, using the Kirchhoff voltage law, we obtain the differential 
equation 


RC dv ou x/dt + t^out — t^in(t) 


(8.32) 


Thus, an RC-network is an example of a first-order dynamic 
system. The most important parameter of the circuit is the time 
constant , x = RC, which defines the time scale for the process 
occurring in the system. 

Example 8.8. Let there be a more complex system formed by two 
RC-networks decoupled by an ideal amplifier of gain K 0 . It is 
presumed that the input impedance of the amplifier is infinitely high, 
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and its output impedance is infinitesimal so the amplifier is an ideal 
decoupling element between circuits. 



On introducing two time constants, x 1 = R 1 C 1 and x 2 = R 2 C 2 , 
we obtain by analogy with the previous example the following 
lst-order differential equations 

x 2 dvout/dt 4- Vout = Kq Vi 
x 1 dvjdt + v x = V{ n (t) 

Eliminating the dummy variable v x between them, we obtain the 
differential equation 

T 1 T 2 d 2 r 0U t /dt 2 + (x x + x 2 ) dt? ou t/d t + t>out = ^o u in(0 (8.33) 

Now, we have a more complex RC -network which is a 2nd-order 
system. 

Example 8.9. Develop the differential equation that describes the 
behaviour of a lossy parallel resonant circuit: 



Here the excitation is a current i(t\ and the response is the voltage 
v(t) across the resonant circuit. 

On combining the currents 

t 


ic = C dv/dt. 



— 00 


i R = v/R 


we obtain the equation 

t 

C dv/dt + 3- J vd^ + v/R = i(t) 

— 00 

Hence, 

d 2 v/dt 2 + 2a dv/dt + (a 2 0 v = (1/C) di/dt (8.34) 

where co 0 = 1/j/Zc is the natural frequency of a loss-free resonant 
circuit, and a= 1/2 RC is the attenuation constant of the resonant 
circuit. 


▲ 

Solve Problem 4 
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The free (transient) response of dynamic systems. A complete 
analysis of the behaviour of a dynamic system described by 
Eq. (8.30) or Eq. (8.31) requires that we should take into account 
the initial conditions characterizing the internal state of the system 
at some fixed instant of time. It is usual to specify the values of the 
sought response function and of its n — 1 derivatives for f = 0: 

w out(0)> w o U t 1) (0). 

From the theory of differential equations [8], it is known that the 
total solution of Eq. (8.31), satisfying any initial conditions, is the 
sum of a particular integral which is a particular solution of 
a nonhomogeneous equation (that is, one whose right-hand side is 
nonzero), and the complementary function which is the general 
solution of the homogeneous equation 

d Wout d ^t/out 

Un —dp- a n -1 £ t n- 1 -b ... + a 0 Uout = 0 (8.35) 

The solving of the homogeneous equation involves finding the 
roots of the characteristic equation of the system 


d n y n + 1 + ... + a o = 0 (8.36) 


The characteristic equation has exactly n roots and, since the 
coefficients of the characteristic equation are real, the roots y l9 y 2 , 
..., may be real or complex conjugate. If all roots are distinct, 
the complementary function, which represents the free (transient) 
response of (free oscillations in) the system, has the form 


The property of the 
roots of the characte¬ 
ristic equation 


Wfree (t) = C 1 exp (y^) + C 2 exp (y 2 t) + ... + C n exp (y n t) (8.37) 

where C 1? C 2 , ..., C n are constant numbers defined from the initial 
conditions. If some roots of the characteristic equation are repeated 
(multiple roots), the form of the complementary function is 
somewhat complicated owing to the appearance of the so-called 

secular factors. Then to each real root of multiplicity k we assign This term has come 
a set of free (transient) response functions of the form over from astronomy 

exp( y,- t), t exp( y,- t), exp( y,- t) 


Consider a few examples of the free (transient) response of (free 
oscillations in) linear stationary circuits. 


t = 0 



Example 8.10. An aperiodic discharge of a capacitor. A capacitor 
of capacitance C, charged to a voltage V 0 , is allowed to discharge into 
a resistor R by closing the circuit at time t = 0. Find the manner in 
which the voltage across the capacitor varies. 

The system can be described by the differential equation 

x dvc/dt + vc = 0 
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and its output impedance is infinitesimal so the amplifier is an ideal 
decoupling element between circuits. 



On introducing two time constants, t 1 = jR 1 C 1 and x 2 = i^ 2 ^ 2 ? 
we obtain by analogy with the previous example the following 
lst-order differential equations 

x 2 duout/df + ^out = K 0 v t 

T x dv 1 /dt+V x = t?in (t) 

Eliminating the dummy variable v 1 between them, we obtain the 
differential equation 

x^d^out/df 2 + (t x + x 2 ) dv ou t/dt + i; 0 ut = Ko v in (0 (8.33) 

Now, we have a more complex RC -network which is a 2nd-order 
system. 

Example 8.9. Develop the differential equation that describes the 
behaviour of a lossy parallel resonant circuit: 



Here the excitation is a current i(t), and the response is the voltage 
v(t) across the resonant circuit. 

On combining the currents 

t 


ic = C dv/dt, 



— 00 


i R = v/R 


we obtain the equation 


C dv/dt + - 


1 


vd£ + v/R = i(t) 


Hence, 

d 2 v/dt 2 + 2a dv/dt + (OqV = (1/C) di/dt 


(8.34) 


where co 0 = l/]/LC is the natural frequency of a loss-free resonant 
circuit, and a = 1 /2RC is the attenuation constant of the resonant 
circuit. 


▲ 

Solve Problem 4 
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The free (transient) response of dynamic systems. A complete 
analysis of the behaviour of a dynamic system described by 
Eq. (8.30) or Eq. (8.31) requires that we should take into account 
the initial conditions characterizing the internal state of the system 
at some fixed instant of time. It is usual to specify the values of the 
sought response function and of its n — 1 derivatives for t = 0: 

W OUt(0)> •••> Wout^O). 

From the theory of differential equations [8], it is known that the 
total solution of Eq. (8.31), satisfying any initial conditions, is the 
sum of a particular integral which is a particular solution of 
a nonhomogeneous equation (that is, one whose right-hand side is 
nonzero), and the complementary function which is the general 
solution of the homogeneous equation 


d u Q ut d n 1 Mout 

dn dP *” dn ~ 1 dr" -1 -*"••• + 0o“out = 0 


(8.35) 


The solving of the homogeneous equation involves finding the 
roots of the characteristic equation of the system 


an r Y n + a n _ 1 y n 1 +f..+a o = 0 


(8.36) 


The characteristic equation has exactly n roots and, since the 
coefficients of the characteristic equation are real, the roots y l5 y 2 , 
..., y n may be real or complex conjugate. If all roots are distinct, 
the complementary function, which represents the free (transient) 
response of (free oscillations in) the system, has the form 


The property of the 
roots of the characte¬ 
ristic equation 


Wfree W = C t exp (y^) + exp (y 2 t) + ... + C n exp (y n t) (8.37) 

where C l5 C 2 , ..., C n are constant numbers defined from the initial 
conditions. If some roots of the characteristic equation are repeated 
(multiple roots), the form of the complementary function is 
somewhat complicated owing to the appearance of the so-called 

secular factors. Then to each real root of multiplicity k we assign This term has come 
a set of free (transient) response functions of the form over from astronomy 

exp(y f t), t exp (y t t), t k ~ 1 exp (y t t) 


Consider a few examples of the free (transient) response of (free 
oscillations in) linear stationary circuits. 


t = 0 



Example 8.10. An aperiodic discharge of a capacitor. A capacitor 
of capacitance C, charged to a voltage V 0 , is allowed to discharge into 
a resistor R by closing the circuit at time t = 0. Find the manner in 
which the voltage across the capacitor varies. 

The system can be described by the differential equation 

x dvc/dt + vc = 0 
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subject to the initial condition 
fc(0) = V 0 

The characteristic equation 
xy + 1 = 0 
has one root 
Y = - 1/x 

The complementary function (the transient solution) can be written 
as 

vc (t) = A exp (— t/x) 

In order to satisfy the initial condition, we should set A = V 0 . So, 
finally, 

vc(t) = Vo ex P (- t/i) 

This result defines the physical significance of the time constant x as 
the time interval during which the free (transient) response decays 
to \/e of its original value (here, e = 2.71828...). 

To sum up, the negative real root of the characteristic equation 
corresponds to a free (transient) response exponentially decaying 
with time. 

Example 8.11. An oscillatory discharge of a capacitor. The circuit 
of the previous example is expanded to include an inductor L. 

On the basis of the Kirchhoff second law, the differential 
equation of the circuit in terms of the current i(t) has the form 

d 2 i/dt 2 + 2a di/dt + coo i = 0 (8.38) 

where a = R/2L and co 0 = 1/j/Zc. 

The obvious initial condition i(0) = 0 stems from the presence of 
an inductor in the circuit-the current through an inductor cannot 
change jumpwise. There is one more condition: At the initial 
instant of time the voltage across the capacitor is balanced by an 
emf of self-induction: 

V 0 A Ldi/dt 1 1=0 = 0 

Hence, 

di/dt\ t=0 = -VJL 

The characteristic equation 

y 2 + 2ay + 00o = 0 

has complex conjugate roots 

Yi, 2 = - a ±7'l/ co o - oc 2 = -a±y‘cof 

where cof is the frequency of the free response of (free oscillations in) 
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the system. As a rule, one is interested in the free response of 
a low-loss circuit, when co 0 »a, so cof^co 0 . 

The complementary function 

i(0 = C l exp (YiO + C 2 exp (y 2 t) (8.39) 

should contain the coefficients C x and C 2 satisfying the following 
set of algebraic equations (see the initial conditions): 

Ci -f C 2 = 0 


Y1C1 + Y2C2 — Vo /T 


Hence, 

C, = - VJljmL, C 2 = Fo/2/cofL 

On substituting them in (8.39), we finally get 

i(t)= -(V 0 /(O{L)exp(- at) sin (Oft (8.40) 


The frequency response. If the excitation applied to a linear 
dynamic system is an exponential signal of the form u m (t) = 
= exp (/cat), then its response will be 

w ou t(0 — K (/co) exp (/cot) 

On substituting these expressions in (8.30) and cancelling out the 
common factor, we obtain the frequency response of the system 


b m (/ c °) m + b m _ j (/co) m 1 + ... + b x (/co) + b 0 
a„ (/co)" + a n _ j (/co)” -1 + ... + a x (/co) + a 0 


(8.41) 


Thus, the frequency response of any dynamic system described by 
ordinary differential equations with constant coefficients is 
a rational function of y'co. The coefficients of this function are the 
same as the coefficients of the differential equation. 

In practice, the frequency response of a linear system is usually 
found by inspection of the applicable circuit diagram, using the 
techniques of circuit theory, without writing differential equations. 


The frequency re¬ 
sponse of a distributed 
system is free from 
this constraint and may 
be described by more 
complex functions 


Example 8.12. For the RC-network of Example 8.7 


K(jco) = 


1/jcoC 
R + 1 //coC 


= 1/(1 +jan) 


(8.42) 


where x — RC is the time constant. 

The equation for the amplitude response takes the form 

| K(/(o)| = l/|/l + oo 2 t 2 
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and that for the phase response 
<Pk (©) = — arc tan (cox) 

From the form of the amplitude response it is seen that the 
circuit in question may be used as a low-pass filter. 

Example 8.13. Analyse the frequency response of an L-section 
two-port consisting of an L, a C, and an R: 


-- | v '« , ‘ 


-0 


\/jaC 


1 


Here, 

K(ja} = R + ;coL + l/jcoC “ (1 - a 2 LC) + jaRC 
Hence, the equation for the amplitude response is 
1 


|X ^ l,)l1 1/(1 - CO 2 LC) 2 + CO 2 R 2 C 2 

and that for the phase response is 
co RC 

«(«)=-arclan 


If the loss resi stan ce R is sufficiently small, so that the system 
g-factor is Q = ]/L/C/R » 1, this circuit may successfully be used as 
a band-pass filter. 




▲ 

Solve Problem 5 


An aperiodically loaded small-signal amplifier. An important 
example of linear dynamic systems is the electronic single-stage 
voltage amplifier shown in Fig. 8.1. 

Here to make the matters more definite, the controlled electronic 
element is an N-P-N bipolar transistor. This may as well be FET (a 
field-effect transistor) or an electron tube. 

So that any such circuits can be analysed in a unified fashion, it 
is customary to draw up their equivalent circuits. The equivalent- 
circuit method is applicable when the amplitudes of the alternating 
voltages around the circuit are so small that the nonlinearity of the 
external (load) characteristics of the devices may be neglected. For 
example, a bipolar transistor can be represented with sufficient 
accuracy by a linear equivalent circuit, if the amplitude of the a. c. 
component of the input voltage is small in comparison with what is 
known as the thermal potential of the P-N junction: 

VT=kT/e 
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Fig. 8.1 Single-stage voltage amplifier: (a) simplified schematic diagram; (b) 
equivalent circuit; R L , load resistor; C s , stray capacitance 

where k is the Boltzmann constant, T is the absolute temperature of 
the junction, and e is the charge on an electron. 

It is shown in circuit theory that the simplest equivalent circuit 
for the output of an active electron device (see Fig. 8.1h) contains 
a controlled current source producing a current — g m vin (where g m 
is the transconductance of the device at the Q-(quiescent) point), 
and the output (internal) resistance of the device, R*, connected in 
parallel with the current source. 

The amplifier’s load is a parallel combination of a load resistor 
Rl and a stray capacitance C s . This type of load is known as 
aperiodic in contrast to an oscillatory load such as an LC-network. 

The overall admittance connected in parallel with the current 
source is 

Tz = 1 /£l + l/Ri +]®C S ^ 

If the excitation applied to the amplifier is a harmonic signal at 
frequency co and of complex amplitude V\ n , the complex amplitude 
of the output signal will be 

Vout= — gmVin/YL 

Hence, the frequency response of the circuit in question is 


~ Qm/^L— £/m^eq/(l A jttiCsReq) (8.43) 


where R eq = RlR*/(Rl + R d- 

Thus, an RC-loaded single-stage voltage amplifier has the same 
frequency response as the RC-network examined earlier. At zero 
frequency, the amplitude response function is a maximum; the 
magnitude of the gain factor is K 0 = g m R Qq . As the frequency is 
raised, the gain falls off due to the shunting effect of the stray 
capacitance. The bandwidth of an amplifier is customarily stated in 


The stray capacitance 
is the sum of the 
output capacitance of 
the electron device and 
that of the wiring 


At T=300 K (stan¬ 
dard temperature) the 
thermal potential is 
25 mV 


The sign is an 

indication that an in¬ 
crease in base voltage 
leads to a rise in 
collector current and 
a decrease in output 
voltage 
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• 

The upper frequency 
limit (or cutoff fre¬ 
quency) of an ampli¬ 
fier 


terms of the upper frequency limit coii m at which the value of the 
amplitude response is l/|/2, or 0.707 times its value at the centre 
frequency*. As is seen from Eq. (8.43), since 


\K(jco)\ = 


then 


QmReq 


]/1 + C0 2 f^eqC: 


— 1/^eq^s 


Example 8.14. The amplifier is set up as shown in Fig. 8.1. Its 
parameters are: = 1.6 kQ, g m = 20 mAV -1 , C s = 30 pF, R t = 

= 15 kQ. Find the gain factor at zero frequency and the bandwidth of 
the system. 

To begin with, we find the equivalent load resistance: 


Req — 


1.6 x 15 
1.6+15 


= 1.45 kQ 


The magnitude of the gain factor at zero frequency is 

K 0 = 20 x 10~ 3 x 1.45 x 10 3 = 29 

The bandwidth of the amplifier is 

co lim = 1/(1.45 x 10 3 x 3 x 10“ n ) = 2.3 x 10 7 s" 1 


▲ 

Solve Problem 10 


Aim = 3.66 MHz 


Absolute stability of a 
system 



Oscillations in an un¬ 
stable system 


The stability of dynamic systems. By definition, a linear system is 
absolutely stable , if all of its natural oscillations are transients 
decaying with time. A necessary and sufficient condition for 
a dynamic system to be absolutely stable is that the real parts of all 
the roots of its characteristic equation, (8.36), are negative. A further 
condition is that the roots should not be purely imaginary. Al¬ 
though the free response of (transients in) the system would then be 
the sum of harmonic functions of the form 

sin 

Wfree(0 = (®o0 
cos 

even minute chance changes in the system parameters might drive it 
into an unstable state when 

sin 

ufree (t) = exp (a t) (co 0 t), a > 0 
cos 


* Otherwise, it is called the half-power bandwidth or the bandwidth 
between half-power points-Translator's note. 
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that is, the amplitude of the response would be building up 
exponentially with time. 

If the order of a dynamic system is sufficiently high, the direct 
check for stability based on the roots of the characteristic equation 
may prove very difficult to perform. To avoid this, special stability 
criteria have been developed. With them, the existence of positive 
real roots can be verified directly from the form of the coefficients 
with no need to solve the characteristic equation. These criteria will 
be taken up in Chap. 14. 

The transient response of an electric circuit can be exponentially 
rising only when in addition to the passive elements L, C and R it 
contains active elements which transfer some of the energy from 
external sources into the circuit. An example of active elements, 
known from circuit theory, is a negative-resistance resistor. 

Example 8.15. A resonant circuit whose parameters are C = 80 pF, 
L = 2.5 pH and R = 12 Q contains a negative resistance connected in 
parallel with the inductive element. Find the critical value of the 
negative resistance at which the system turns unstable. 

As can be readily verified, the differential equation of the above 
circuit, written for the voltage v across the inductive element has 
the form 

(1 + R/R neg )d 2 v/dt 2 + (R/L+ \/R nQg C)dv/dt + v/LC = 0 (8.44) 

The roots and y 2 of the characteristic equation have real parts 

_ R/L + 1/RnegC 
CTl ’ 2 2(1+R/Rneg) 

The system will go into an unstable state if Rey 1>2 becomes zero. 
Hence, the critical value of the negative resistance is given by 

£neg,cr= - L/RC = - 2.604 kQ 

Thus, the system in question will jump into oscillations 
spontaneously, if the negative resistance it contains is R neg > 
- 2.604 kQ. 



8.4 Spectral (Frequency-Domain) Analysis 

When speaking about spectral (frequency-domain) analysis as 
applied to the response of linear stationary systems, what is usually 
meant is a range of mathematical techniques based on the use of 
the properties of the frequency response. In the pages that follow, 
several examples will be examined in order to demonstrate the 
application of the spectral approach to directly finding and 
numerically evaluating the output signal of a system. 
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The basic equation. Let the excitation applied to the input of 
a linear stationary system be a deterministic signal «i n (t) specified 
by its expansion into the Fourier integral: 

00 


Uin(t) = 


2it 


1 


Sin (©) exp (/cot) dm 


(8.45) 


Suppose that the mathematical model of the system is specified 
by its frequency response K(j(£>). As will be recalled, the complex 
signal exp (/tot) is the eigenfunction of the system, giving rise to an 
elementary response K (/co) exp (/cor) at the system’s output. By 
combining the two signals, we obtain the spectral representation of 
the response: 


00 

i r 

Wout(0 = 

Z71 

%/ 

— 00 


K (/co) 5in (co) exp (/cor) dco 


(8.46) 


The principle of spec¬ 
tral (frequency-do¬ 
main) analysis 


This is the basic equation of the spectral method. As is seen, the fre¬ 
quency response is a coefficient of proportionality between the spectra 
of the input and output signals 

SoutM = •£(/©) Sin (CO) (8.47) 


Thus, a remarkable feature about system analysis in the fre¬ 
quency domain is that the effect of signal transformation in 
a system is represented simply by the algebraic operation of 
multiplication. 

It should be stressed that the frequency-domain (spectral) 
approach and the time-domain approach are each other’s 
equivalents. Indeed, the Duhamel superposition integral (8.8) is the 
convolution of the function Ui n (t) and the impulse response in the 
time domain: 


Uout(t) — Ujn (t) * h (t) 

In consequence, the spectrum of the output signal is the product of 
the spectra of the functions uj n (t ) and h(t). Equation (8.47) follows 
directly from this statement. 

The practical value of finding the response of a system by the 
spectral method depends in each particular case on whether the 
integral in (8.46) can be evaluated. 

Computation of the impulse response. As a rule, no fundamental 
difficulties arise in finding the frequency response of a linear system. 
Therefore, if it is required to find the impulse response h(t) of 
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a system, it is advantageous to use the spectral method by which 



00 

R(/co)exp(/oc>t)dco 


— 00 


As an example, let us find the impulse response of an 
RC-network whose output signal is the voltage across the capacitor. 
Here 


K(jco) = 


1 

1 T- ycoRC 


and so the impulse response is 




exp (/cot) dco 
1 + ycoRC 


— 00 


(8.48) 


Let us employ the residue method [11] and assume that co is 
a complex variable. The integration contour in (8.48) is formed by 
the entire real axis lmco = 0 and an arcQ of an infinitely large 
radius, which may close in both the upper and the lower half-plane. 
The integrand in (8.48) has a single simple pole at a point co p = 
= j/RC. The residue of the integrand at that point is 


= (l//RQexp( — t/RC) (8.49) 

CO=CD p 

Let us find h(t) for t > 0. To this end, the arc C i must be located 
in the upper half-plane, because it is only then that the function 
exp (/cot) will tend exponentially to zero with increasing radius of 
the arc. In the limit, the contour integral will be equal to the 
integral taken solely along the real axis in accord with Eq. (8.48). 

By Cauchy’s residue theorem, the contour integral of an analytic 
function is equal to 2nj multiplied by the sum of the residues of the 
integrand at all poles lying inside the contour of integration. Thus, 


exp (/cot) 

1 + ycoRC 


h(t)\ t>0 = (l/RC)exp( — t/RC) 


(8.50) 


If we want to find the impulse response for t < 0, the contour of 
integration must be closed in the lower half-plane where the 
integrand has no poles at all, and so 

h(t)\t< 0 = 0 (8.51) 



Graphically, the impulse response of an RC-network constructed 
on the basis of Eqs (8.50) and (8.51) is a curve discontinuous at t = 
= 0 (Fig. 8.2). 

The representation of discontinuous functions by contour 
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▲ 

Work 
and 7 


Problems 6 



▲ 

Work Problem 8 


integrals is a mathematical device widely used in a variety of 
theoretical studies. 

Computation of the output signal. As an example of using the 
spectral method, let us find the response of the RC-network defined 
earlier to the exponential video pulse 

Win(r)= U o exp ( — at) a (t) 

Now the spectrum of the excitation is 

Sin (©) = U 0 /(a+Jco) 

h(t)RC 



tl(RC) 


Fig. 8.2 Plot of the impulse response of an PC-network 

and the problem reduces to evaluating the integral 

00 

tTT n , f exp (/cot)d© 

Mout(0 = ( U 0 /2na) - . 

J (1 +7©/ a )(l +JURC) 

— 00 

On expanding the integrand into partial fractions, we get 
1 1/1 aRC 


(8.52) 


(1 + 700 /oc) (1 + j(oRC) 1 — clRC \ 1 + j(o/a 1 + j(oRC 

Since the terms in the parentheses have the same structure, we may 
directly use the results obtained in finding the impulse response and 
write the solution as 


U n 


[exp (— cut) — exp (— t/RC)~] 


(8.53) 


|Mout(t)|i>o--j _ aRC 

Naturally, 

w out(0 I t < 0 = 0 

The applicable plot appears in Fig. 8.3. 

The frequency response of a multistage system. 
Characteristically, telecommunications use complex systems in 
which the individual sections are connected in cascade so that the 


(8.54) 
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-10 1 2 3 


Fig. 8.3 Response of an RC-network to an exponential video pulse. (Note 
that the network smoothes the input signal.) 


output from a previous stage acts as the input signal for the next. 
An example is a multistage amplifier. 

Suppose that we know the frequency responses of the individual 
stages K n (jco) (n= 1, 2, ..., N), where N is the total number of 
stages. If the excitation for the first stage is 

M in (0 = exp (/cot) 

its output signal will be 

wout ( t) = K 1 0'co) K 2 (/co). . .Kn (/cd) exp (/cot) 

Hence, the overall frequency response of the system is 

N 

^overall(/©) — n K n (j(ti) (8.55) 

71=1 



In engineering practice, the amplitude (magnitude) response of 
systems is ordinarily expressed in decibels , special logarithmic units. 

If at any frequency co we know the magnitude of the frequency 
response, then the gain of the system at that frequency, as expressed • 
in decibels, will be Decibels 


A = 20 log 10 \K(jco)\ (8.56) 


A system for which | K (/co) | < 1 will attenuate the signal, and 
instead of a gain we have a loss, or negative gain. 

It is an easy matter to see that when several stages are connected 
in cascade, their gains are added together: 

N 

Aoverall = A n 

71=1 


(8.57) 
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Differentiating and integrating networks. In telecommunications, 
linear circuits are frequently used to change the waveform of pulse 
signals. 

Consider an RC-network for which the output signal is the 
voltage across the resistor. The differential equation of this system 


—ii—r 

-0 


(8.58) 

> *0 

1 

xdvR/dt + vr = xdvm/dt 

p 

If the time constant x is so small that 


I 

- 0 

x| dvR/dt | «\vr\ 

(8.59) 


at any instant of time, we may neglect the first term on the left- 
hand side of Eq. (8.58) in comparison with the second, and so 



and the output signal 
of a differentiating net¬ 
work 


vr v tdrin/d t 


(8.60) 


that is, if the condition (8.59) is satisfied, the RC-network performs 
the approximate differentiation of the applied signal. In practical 
applications, differentiating networks are used for pulse peaking (or 
sharpening). 

Clearly, whether the inequality (8.59) is satisfied or not depends 
not only on the circuit parameters, but also on the characteristics of 
the input signal. For estimation purposes, it is simpler and more 
instructive to use analysis in the frequency domain. The frequency 
response of the circuit in question 


K(j(o) = 


_Jan_ 

1 + jCOT 


will be close to that of an ideal differentiator 
K O'co) « jcox 


if the product cox is negligible in comparison with unity in that fre¬ 
quency region where the bulk of the signal energy is concentrated. 
As an example, let the input signal be a rectangular video pulse of 
duration x p . Using a rough estimate for the upper frequency limit 
(the bandwidth) of the pulse 


®lim — 27l/Tp 

we obtain the condition for the applicability of an RC-network for 
the approximate differentiation of such a signal 

x = RC « x p /In (8-61) 

If in an RC-network the output signal is picked off the capacitor, 
the situation will be the reverse of the previous case. Here, 


xduc/df-1- vc = 
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and, if the circuit and excitation parameters are such that 

x\dvc/dt\ »\vc\ 

then 



vc(t )» 


1 

T 


Min©d5 


— 00 


(8.62) 


An RC-network possessing the above properties is called an 
integrating network. 

The accuracy of approximate integration improves as the fraction 
of h. f. components in the spectrum of the excitation increases. To 
demonstrate, since here 

K(jc o) = 1/(1 +jm) 

then the approximate equality Solve Problem 9 

K (yco) « 1 //cox 


assuring the integrating properties of the network will take place if 
coji» 1, where coj is the lower frequency limit of the signal 
bandwidth. 

Integrating networks capable of suppressing the h. f. components 
of the input signal are oftgi used as smoothing filters. Also, they 
can convert stepwise changes in the input signal (step inputs) into 
a lineary rising (or ramp) output voltage. 

Geometric interpretation of signal transformation in a linear 
system. The spectral method provides a tool for an easy-to-grasp 
analysis of the transformations that a signal experiences in passing 
through a linear stationary system. From the view-point of the 
geometric concepts developed in Chap. 1, the system operator T 
defines the law by which one signal u m (t) in some linear space is 
transformed, or mapped, into a new signal u 0U t(t). As a rule, this 
functional space is a Hilbert space. Then, in the most general case it 
may be argued that the operator T changes the norm of the signal 
Um(t\ that is, 




II Win || # || Twin II 


Also, an angle \|/ is formed between the signals wi n and w ou t- 
By the Rayleigh formula (see Chap. 3), the energy of the output 
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signal is given by 


£out — II w 0 ut II 2 — ~ 2 ~ 


00 

S 0 ut(ffl)S$ut(co)dco 


— 00 


|iC(/C0)| 2 (co)dco 


(8.63) 


where ILin(co) is the power spectrum of the input signal. 
In accordance with (8.63), 

^out(co)-|X(/'co)| 2 irin(co) 


The quantity 

• - 

The power transfer Kp (co) = | K (/co) | 2 (8.64) 

response _ 

is called the power transfer response at the specified frequency co. 
Since this function is real, the energy of the output signal is far 
simpler to find than the exact form of the output signal. It is to be 
noted that in many cases it is quite enough to know only the 
manner in which the energy of the signal passing through a linear 
system varies. 


Example 8.16. Let an RC-network with a frequency response 
X(/co)= 1/(1+7 'cot) be driven by an ideal low-pass signal whose 
power spectrum is W 0 in the frequency interval 0 < co < co c {where co c 
is the cut-off frequency) and zero elsewhere. Find the input to output 
signal energy ratio. 

In this case, 

Kp{ oo)= 1/(1 +co 2 x 2 ) 


By Eq. (8.63) 


Eout = (W 0 /n) 


o 


dco 

1 + co 2 t 2 


(W 0 /kt) arc tan co c x 


Kp (co) = K (/co) K ( — /co) 


The energy of the input signal is 
Em = W 0 (o c Jn 

Therefore, the energy ratio 
r| = E out /Ei n = arc tan co c t/(co c t) 


(8.65) 
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tends to zero as both the time constant x and the cut-off frequency 
co c are increased. 


The angle between the input and output signal phasors. In Chap. 
1 it has been shown how two signals can be compared by finding 
the angle \|/ between the signal phasors in the Hilbert space. This 
idea can be utilized for comparing the input and output signals of 
a linear stationary system. 

By the generalized Rayleigh theorem, the scalar product of the 
two signals can be expressed in terms of their spectra 

1 00 

(«in, «out) = — j S in (C 0 )SW(ffl)dC 0 
2n -oo 

^ 00 

= — J Sin (CO) S* i n (ffl) K* (/CO) d(0 
Z7T — oo 


▲ 

Solve Problem 14 


1 00 

= — j W m (a) K* (ja) dco 

Z7I _ oo 

Since the imaginary part of the frequency response is an odd 
function of frequency, the above equation can be simplified as 
follows: 

1 00 

(Win, Wout) = — j Wm(co) Re K (/co) dco (8.66) 

71 o 

The angle \|/ between the phasors of the input and output signals 
can be found from the relation 


cos \)/ = 


( w in, Wout) 

II Win II * II W 0 ut II 


(8.67) 



Example 8.17. Find the angle v|/ between the input and output 
signals in the RC-network of Example 8.16. 

Since here 

Re K (/co) =1/(1 + co 2 x 2 ) 

it follows that the integral (8.66) is numerically equal to the square 
of the norm of the output signal. Hence, 

(8.®) 


If the product co c x»l, then cos\|/->0, and this implies that the 
output signal of the RC-network is nearly orthogonal with respect 
to the input signal. An insight into this effect can be obtained from 
quantitative considerations, if we recall that the network delays the 
output signal owing to the lag in its response. 
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The autocorrelation characteristic of a system. Before we 
conclude our overview of spectral (frequency-domain) analysis as it 
is applied in the theory of stationary systems, one more useful 
function must be mentioned. This is the autocorrelation 
characteristic of a system, H(x). Customarily, it is defined as the 
Fourier transform of the power transfer function 

1 00 

S(t) = —— j K p(co)exp(/cot)dco (8.69) 

271 — oo 

Alternatively, the function in (8.69) may be expressed in the time 
domain. To this end, we note that 

Kp((») = K(jG))K*(j(o) 

Therefore the relation between Kp( co) and S(i) must be the same as 
has been found (in Chap. 3) to exist between the power spectrum 
and the autocorrelation function of an arbitrary signal 

00 

3(t)= | h(t)h(t-z)dt (8.70) 

— 00 


8.5 The Operational Method 


In this book the term 
“operational method” 
refers solely to the 
Laplace transforma¬ 
tion 


There is a widely used operational method of analysis closely 
related to the spectral method just discussed. It is based on 
representing input and output signals by their Laplace transforms. 

Solving differential equations by the operational method. This 
method is an exceptionally flexible and powerful tool enabling one 
to solve linear differential equations with constant coefficients by 
formalized procedures. Precisely this property has made it so 
popular in the study of linear dynamic systems. 

Let the differential equation 

d u OU i d n 1 u 0 ut dwout 

an ~~dt" - hUyi ~ 1 d-*" +fll_ dt— h “°“out 


= b„ 


d m u h 

dt m 


" b m _ i - 


d m “ 1 Win 


dr m " 


'+••• + b 0 Win 


(8.71) 


define the input-output relation for a linear stationary system. We 
impose an important constraint: We deem that u m (t) = 0 for t< 0. 
Also, in view of the class of problems dealt with in the present text, 
we deem that the system does not contain any stored energy up to 
the instant when the input signal occurs. Mathematically this means 
that we should choose zero initial conditions: 


W OUt (0) — M OUt (Q) *“ • • • — w out } (0) — 0 

Finally, we assume that the area of feasible input signals does not 
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contain any functions so rapidly increasing with time that no 
Laplace transform exists for them. 

The correspondence between the original signal and its Laplace 
transform will be designated as follows: 

Win(0 = Uin(p)y w out(0 = U 0 ut{p) 

On taking the Laplace transforms of both sides of Eq. (8.71), we 
get 

(a n p n + a n _ x p n 1 -j-... + a x p + a 0 ) U 0 ut(p) 

= (b m p m + b m _ lP m ~ 1 + ... + b lP + ho) Uinip) (8.72) 


The most important characteristic that forms the basis of the 
Laplace transform method is the ratio of the transform of the out¬ 
put signal to the transform of the input signal: 


K(p)=U 0Ut (p)/U in (p) 


(8.73) 


called the transfer function of a system. 
In accordance with Eq. (8.72), 

b m p m + h m _ 1 p m ~ 1 + ... +b 1 p + b 0 
P ~ a n p n d-a n _ 1 p n ~ 1 + ... +a 1 p + a 0 


(8.74) 


Within the framework of the Laplace transformation, the transfer 
function is a complete mathematical model of the system. If the 
transfer function of a system is known, the response of the system 
to a specified excitation can be found by a procedure which can be 
broken down into three steps: 


The transfer function 
of a system 


( 1 ) Uin(t) —^► U‘m(p) 

(2) U oui (p)=K(p)U in (p) 

(3) U 0 ut(p)~* Mout(0 


Historically, the operational method goes back to the operational 
calculus proposed by Heaviside as far back as the end of the 19th 
century for solving differential equations describing non-stationary 
processes in linear electric circuits. The Heaviside method is based 
on the formal replacement of the differentiation operator d/d t with 
a complex number p. (For connections between the Heaviside and 
Laplace transform methods the reader is referred to [11].) 

Properties of the transfer function. Comparison of Eqs. (8.74) and 
(8.41) will show that the function K(p) is an analytic continuation 
of the frequency response K ( 700 ) from the imaginaly (/co) axis to the 
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entire plane of the complex frequency p = a + 7 ®. The function 
K(p) is analytic over the entire p-plane, except for a finite number 
of points p v p 2 , Pn , which are the roots of the denominator in 
(8.74). These points, that is, the roots of the equation 

Grip* 1 + &n-lP n 1 + .. • + CliP + CIq = 0 

are called the poles of the transfer function K(p). 

The set of points z v z 2 , z m , which are the roots of the 
equation 

b m z m + b m _ 1 z m 1 + ... + b±z + b 0 = 0 
are the zeros of the transfer function. 

^ On placing out the common multiplier K 0 which arises when the 

Poles and zeros numerator is divided into the denominator in Eq. (8.74), we may 

write K(p) in the so-called pole-zero representation: 


, „ (P-Zi)(p-Z 2 )--(P-Znd 

(P ’ >-P,)(i>-P 2 )-(P-Pn) 


The usual practice is to 
show poles as stars and 
zeros as circles 


Work Problem 11 


Since the coefficients of the differential equation (8.72) are real, 
the poles and zeros have an important property: They are all either 
real or form complex conjugate pairs. 

Frequently, the transfer function is depicted graphically by means 
of the so-called pole-zero diagram which is a plane where the 
coordinates of the points are marked by suitable symbols. The 
transfer function K(p), being complex, cannot in itself be presented 
in graphic form. Therefore, the usual procedure is to show the 
three-dimensional surface of the function \K(p)\ over a plane with 
Cartesian coordinates (Fig. 8.4). 

The surface has a typical “mountainous” appearance, with the 
infinite peaks corresponding to the poles of the transfer function, 
and with the valleys to its zeros. On cutting the surface with 
a plane which contains both the vertical axis and the y’co-axis, we 
obtain the amplitude response profile of the system. 

The poles of the transfer function for a linear circuit are nothing 
but the roots of the characteristic equation (8.36). Therefore, for 
a system to be absolutely stable, it is necessary and sufficient that 
these poles lie only in the left-hand half of the p-plane. In the 
general case, the zeros of the transfer function may be located in 
both the left-hand and the right-hand half of the p-plane. 

The Laplace inversion formula. The final step in finding the 
response of a linear system to a signal by the Laplace transform 
method is the recovery of the original time function for which the 
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I K\ 



Fig. 8.4 The appearance of the K (p) surface for a transfer function having 
two complex conjugate poles: p M = - a ±7 cd 0 , and one zero: z = 0 


Laplace transform is 

Uout(p) = K(p)U in (p) 

Consider the special case when the function U out {p) is the ratio 
of two polynomials in powers of the complex frequency: 

U out(p) = M (p)/N (p) 

such that the power m of the numerator does not exceed the power 
n of the denominator and also the roots of the denominator pi (i = 
= 1 , 2 , ..., n) are simple. 

The method by which the original time function can be recovered 
from its Laplace transform is based on the representation of 
Lout (p) as a sum of partial fractions: 

Lout (p) = ^ C; 

i=i P~Pi 


The coefficients C\ are the residues of the function L ou t(p) at poles, 
therefore [ 11 ] 


Lout (p) — 


y M {pi) 1 

i= 1 N'fri) P-Pi 


(8.75) 


As will be recalled, 1 /(p — Pi) is the Laplace transform of exp (pit). 
Hence, the following Laplace inversion formula results from (8.75): 


U OUt (t) — 



exp (pit) 


(8.76) 
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Example 8.18. Find the step response of an RC-network. 
Here, c(t) =1 /p and K(p) = 1/(1 + px). Therefore, 

U 0 ut(p) = l/p(l+pr) 

On expanding into partial fractions, we get 



u out (P) — 

p 


1 

p + 1/t 


The original time functions corresponding to the two terms on the 
right-hand side of the above equation are well known (see Chap. 2). 
The result is 


0(0 = [1 — exp( — t/x)] ct(0 


(8.77) 



0 


Finding output signals by the Laplace transform method. In 

using the Laplace transform method, the bulk of the computational 
work can be avoided by reference to the widely known tables of 
Laplace transform pairs (see Appendix 4). 


Example 8.19. The response of an RC-network to a rectangular 
video pulse. Let the excitation applied to the RC-network shown in 
the accompanying figure be a rectangular voltage video pulse of 
known parameters V 0 and T. Find the function describing the output 
signal 

The Laplace transform of the input signal is 
Vm(p) = (V 0 /p)[\ -exp(-pT)] 

The term exp(-pT) implies that there is a time shift by T. 
Therefore, on the basis of the results obtained in Example 8.18, we 
may write 

v C ® = v 0 (\ - e - ( V(t) -V 0 [\- e- (t - T)/x ]a(t - T) (8.78) 




It is more instructive to re-write (8.78) as 
v c (t) = F 0 (l - e - £/T ) for 0 < t < T 

v c ® = - F 0 e- £/T (l - e for t > T (8.79) 


If the output signal is picked off the resistor, then for the same 
values of R and C, the voltage across the resistor will be 

vr®= v m -vc(t) 

The respective plots appear in Figs. 8.5 and 8.6. 

Example 8.20. The impulse response of a parallel resonant circuit. 
Let a lossy parallel resonant circuit be driven by a delta impulse of 
current in the common part of the circuit. The output signal is the 
voltage across the circuit. 

The equality V(p) = Z (p) I (p) indicates that in this case the 
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Vc/Fo 



Fig. 8.5 Time variations in the voltage across the capacitor of an 
RC-network driven by a rectangular video pulse of T = lps duration: ( 1 ) 
for T/x = 0.2; (2) for T/x = 5 



Fig. 8.6 Time variations in the voltage across the capacitor of an 
RC-network driven by a rectangular video pulse of T=lps duration: (1) 
for T/x = 0.2; (2) for T/x = 5 


transfer function is the Laplace transform of the resonant-circuit 
impedance 


7( ) pRL P/C 
P p 2 LCR + pL + R p 2 + 2ap + & 2 0 


(8.80) 


where a = 1 /2RC and coq=1/LC. 

It is convenient to re-write Eq. (8.80) as 


Z(p) = 


P/C _ 

(p + a) 2 + © 2 f 


(8.81) 


where co f =]/co^-a 2 is the natural frequency of the lossy resonant 
circuit (the frequency of its free response). 
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The Laplace transform of the delta-impulse of current is unity, so 
the impulse response of the network in question is the original time 
function corresponding to the Laplace transform in (8.81). From the 
tables in Appendix 4 we find 

h(t) = ——(coscoft ——sincoft) (8.82) 


If the resonant circuit has a high Q and a«co 0 , Eq. (8.82) can be 
somewhat simplified: 


h(t) 


exp( — at) 
C 


cos co 0 t 


(8.83) 


The impulse response of a resonant circuit and, indeed, that of 
any other linear oscillatory system has the typical form of 
a harmonic wave with an envelope exponentially decreasing in time. 

It is important to remember that Eqs. (8.82) and (8.83) hold when 
a resonant circuit is driven by an infinitesimally short current pulse 
whose area is, however, finite and is equal to 1 A s. On a real scale, 
this would be a very large quantity-a rectangular pulse of 1 ps 
duration would have a gigantic amplitude of 10 6 A. It is not 
surprising, therefore, that with C = 1000 pF such a pulse would give 
rise to a voltage of 10 9 V at the initial instant of time. A real pulse 
of 0.01 A amplitude and of 1 ps duration has an area of 10" 8 A s, 
and for C = 1000 pF the initial voltage across the resonant circuit is 
a mere 10 V. 

To sum up, the equation used to calculate the voltage produced 
across a parallel resonant circuit driven by a short current pulse of 
an arbitrary waveform is as follows: 


y out(0 — 


^4 p exp( — at) 
C 


(coscoft-sincoft) 

CGf 


(8.84) 


where A p is the area of the pulse. 

Example 8.21. The step response of a series resonant circuit . 
Here, the transfer function is 


K(p) = 


1 IpC 

pL+R + l/pC 


m 


+ 2a p + co 


2 

0 


where a = R/2L. The excitation is the Heaviside function for which 
the Laplace transform is 1/p. Hence, 

v ( \ 0)9 

0UtW “ p[(p + oc) 2 + co f 2 ] 

From the table of Laplace transform pairs, we finally get 


q(t) = 1 - e a * (cos CGf t H -sincoft) 

* CDf 




(8.85) 


0 
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As is seen from the plot of the function g(t\ the unit step input 
causes the system to oscillate so that it approaches a new steady 
state asymptotically. 

Example 8.22. Connection of a harmonic emf source to an 
RC-network. 

Let 

Vin(t)= F m sinco 0 tc(t) 

The Laplace transform of the above signal is 



Vout 


^out 


v in (p) = 


I'm® o 
P 2 + ©0 


Since 

K ( p ) = 1/(1 + pi) = a Up + a) 

where a = 1/x, it follows that 

t / V m aca 0 

^OUt \P) ~ , w 2 . „2\ 

(p + CL)(p Z + C0g) 

From the table of Laplace transform pairs we find 

a 


Fm aco n _ 

FoutW = r( e - cos ®0 1 + 

mi + or 


The first term in the parentheses on the right-hand side 
represents a decaying free (transient) response. If af»l, the solution 
will only retain the forced (or steady-state) response which varies in 
time harmonically. 


-sin co 0 £) 


( 8 . 86 ) 


Many more examples could be added to those given above, 
including more complicated ones such as the connection of 
a harmonic emf source to a resonant circuit. However, the exact 
solutions that are obtained are fairly unwieldy. It appears more 
convenient to carry out the analysis by the method applicable to 
nonstationary processes in oscillatory circuits, set forth in Chap. 9. 


Summary 

The relation connecting the input and output signals of a system is called the system 
operator. 

Systems are classed according to the properties of system operators. Systems may be 
linear or nonlinear, stationary or nonstationary, lumped-constant or distributed- 
constant. 

<0^ The response of a linear system to a delta impulse is called the impulse response of 
that system. 

<X> The output signal is the convolution of the input signal and the impulse response. The 
frequency response function and the impulse response function are related by 
a Fourier transform pair. 
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The free (transient) response of a dynamic system is defined by the roots of the 
characteristic equation. 

<X> A dynamic system is absolutely stable, if all the roots of the characteristic equation 
have negative real parts. 

The frequency response of a linear dynamic system described by an ordinary 
differential equation is a rational function of frequency. 

03> The spectrum of the output signal is the product of the frequency response and the 
spectrum of the input signal. 


Review Questions 

1. Give several examples of linear and nonlinear, stationary and nonstationary systems. 

2. What are the conditions under which the response of a linear system to a short input 
pulse may be represented by the impulse response of the system? 

3. State the condition for the physical realizability of a system. 

4. Define the step response of a system. How are the step response and the impulse 
response related? 

5. Define the frequency response function of a linear stationary system. 

6. Formulate the Paley-Wiener criterion. 

7. What is the salient property of dynamic systems? 

8. Write the equation defining the frequency response of an aperiodically loaded 
small-signal amplifier. How is its cut-off frequency (bandwidth) defined? 

9. What is the essence of the spectral (frequency-domain) analysis of dynamic systems as 
applied to their response? 

10. What logarithmic units are used to express the gain of a system? 

11. Draw up schematic circuit diagrams for a differentiating network and an integrating 
network and explain their principle of operation. 

12. How does a linear circuit transform the input signal phasor regarded as an element of 
the Hilbert space? 

13. What is the power transfer function? 

14. Define the transfer function of a linear stationary system. 


Problems 

1. The impulse response h(t) of a linear 
stationary system is a triangular pulse: 



The circuit is excited by the signal 


fin M 


at, t> 0 
0 , t < 0 


Find the response of the system. 

2. Calculate the impulse response of an 
ideal integrator for which 

t 

fout(0 = Jfinft)d^ 

0 
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3. The block diagram of a system has the 
form 



The arm A contains a delay unit which 
delays the input signal for a time T, and the 
arm B a scaler (amplifier) of gain K 0 . Find 
the impulse response of the system. 

4. Write the differential equation de¬ 
scribing the following circuit: 


- L-J - M 

' -1-* 

C, 


C 2 = 

Hl 


Vout 


-0 


The equation must be written for the 
unknown function v 0 ut(t)- 

5. Find the frequency response functions 
for the systems in Problems 3 and 4. 

6. Calculate the impulse response of the 
RL-network whose circuit diagram has the 
form 


-0 

hit ) 

-0 

7. Calculate the impulse response of the 
circuit examined in Problem 4. 

8. Analyse Eq. (8.53) for a = 1/RC. 

9. Establish the conditions under which 
the circuit shown in the accompanying 
diagram: 




can serve as a network taking 
an approximate integral of the input 
signal. 

10. The multistage FET amplifier shown 
in the accompanying diagram contains 
a d.c. blocking capacitor Ct>: 


1 



R 


x 

As its name implies, its function is to block 
the transfer of the high d.c. potential from 
the drain of the previous stage to the gate of 
the next. The amplifier is intended to 
amplify rectangular video pulses of duration 
T— 1 ms. Considering that the resistor value 
is R = 0.5 MQ, and the FETs have an 
infinite input impedance, determine the 
value of Cb for which the gate voltage (see 
the schematic) drops by not more than 5% 
from its maximum level over the pulse 
duration T. 

11. Find the transfer function of 
a two-stage amplifier consisting of identical 
RC-loaded stages. The parameters of one 
stage are g m = 10 mA V -1 , R = 0.3 kD, Rt = 
= 7 kD, and Cb= 120 pF. The capacitance 
of Cb (see Problem 10) is so high that its 
effect on the amplifier performance may be 
neglected. 

12. A series LCR resonant circuit is 
excited by 

fin (t)= otter (t) 

Derive the relations defining the manner in 
which the voltages across the capacitor and 
the inductor vary. 


9-728 
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Advanced Problems 

13. Find the frequency response and the 
impulse response of the circuit shown 
below: 


lb 

c 2 


1 — *— 1=3 — i 

r— czi * < 

1 R 

R t 

C i — 

_ l 

> -c 


14. An RC-network is excited by 
Vm(t)= V 0 exp ( — at) a (t) 


The output signal is picked off the capacitor. 
Determine the angle between the input and 
output signal phasors in the Hilbert space. 

15. Analyse the step response of an 
oscillator circuit using a model consisting of 
a weight suspended on a cord. The 
excitation is a step displacement of the point 
of suspension of the weight (pendulum) in 
a horizontal direction. Select by experiment 
the form of excitation that would move the 
system from one steady state to another in 
a finite time. Draw the conclusion about the 
limiting speed of response of the oscillatory 
system. (TTiis problem is an illustration to 
the theory of optimal control [42] which is 
a rapidly expanding division of present-day 
cybernetics.) 


Chapter 9 

Response 

of Frequency-Selective Systems 
to Deterministic Signals 

Since their early days, telecommunication systems have been 
widely using frequency-selective linear circuits in order to extract 
wanted signals. Circuits in this class attenuate all frequencies except 
those lying in the relatively narrow band around the centre fre¬ 
quency. Frequency filtering is effective when the signal being 
processed is sufficiently narrowband. Examples are the various 
modulated signals examined in Chap. 4. 

Narrowband frequency-selective circuits or, as they are more fre¬ 
quently called, linear narrowband frequency filters, have a number 
of specific properties. In this chapter the reader will learn the 
techniques and procedures developed for the analysis and synthesis 
of such circuits, including their characteristics and responses. 


9.1 Models of Frequency-Selective Circuits 

The simplest frequency filter is a resonant circuit formed by 
appropriately interconnecting an inductor L, a capacitor C, and 
a resistor R. Series as well as parallel resonant circuits are dealt 
with in a course on circuit theory. Without going into a detailed 
derivation which is presumed to be known to the reader [25] we 
will re-state the basic points which will be frequently used in the 
subsequent discussion. 

Frequency response o£ a series resonant circuit, if we take the 
input as a voltage and the output as a current, the behaviour of 
a series resonant circuit driven by a harmonic excitation will be 
described by the complex input (or driving-point) admittance 




i 

R+j(oL+ l/ycoC 


(9.1) 


At the resonance frequency, © res =l/|/LC, the admittance of the 
resonant circuit is purely conductive 

Y„=l/R 
The quantity 

p = i/L/C (9.2) 

is called the characteristic impedance of the resonant circuit. 
The frequency-selective properties of this system improve with an 



9 * 
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increase in its Q-factor defined as 

Q = p/R = © res L/R = 1 /“res RC ( 9 - 3 ) 


Generalized detuning 


It is customary to introduce the absolute detuning Aco of the input 
harmonic signal relative to the resonance frequency by writing the 
source frequency as 
CO = C0 res + Aco 

and also the dimensionless relative detuning 

v = (0/co r es — t»resA° ^-4) 

which vanishes at the resonant frequency. 

Finally, there is the generalized detuning £ which is defined as the 
ratio of the reactive impedance of the resonant circuit to the loss 
resistance: 


£ = — (coL-l/coC) = ev 
R 


(9.5) 


The admittance of a series resonant circuit can be expressed in 
terms of the generalized detuning as 


Y = y R .r = I *1 exp O'cp) ( 9 - 6 ^ 

i +A 

From Eq. (9.6), the amplitude response of the resonant circuit can 

A be written as 

Solve Problem 1 

m= 

and the phase response as 
<p = - arc tan \ 

The plots constructed on the basis of Eqs. (9.7) and (9.8) appear in 

Fig. 9.1. r 

The magnitude of the admittance decreases to l/|/2, or 0.707 
times the resonant value at frequencies such that %= ± 1. Also, 


V R (9.7) 

l/i + ¥ 


©res + Aco _ ^res \ _ + ^ 

\ ©res ©res + A© ) 

If Q» 1, the equality will be satisfied at low values of the ratio 
A©/© res . Therefore, approximately 

2Q A©/© res = + 1 
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\Y\R <P> rad 



Fig. 9.1 Admittance of a series resonant circuit as a function of generalized 
detuning: (a) magnitude; (b) phase 

Hence, the bandwidth of the resonant circuit between the 0.707 
points will be 

BW 0 707 = 2 I Aco I = C0 r es/6 (9.9) 

Frequency response of a parallel resonant circuit. At the 

resonance frequency a series resonant circuit has a very low 
impedance the magnitude of which sharply increases with the 
amount off resonance (detuning). For a parallel resonant circuit the 
impedance at resonance 

Kres=p6 (9.10) 

being likewise purely resistive, is a maximum in magnitude. 

Taking the input as a current, and the output as a voltage, the 
frequency response of a parallel resonant circuit is called the 
complex input (driving-point) impedance , Z(yco). It is convenient to 
express the frequency response function, taking the generalized 
detuning 4 as the argument: 




l^res 


(9.11) 


The plots of the amplitude and phase of Z (y^) are exactly the same 
as appear in Fig. 9.1 for the complex admittance of a series 
resonant circuit. 

If the Q-factor is sufficiently large so that in the direct vicinity of 
the resonant frequency we may express the generalized detuning by 
an approximate formula of the form 


2@ (tO Q) r es) 

COres 


(9.12) 



A 

Solve Problem 2 
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then the amplitude response, that is the frequency depedence of the 
magnitude of the input impedance, of the parallel resonant circuit is 
represented by the so-called resonance curve (also called the 
resonant curve or characteristic) which is symmetrical about the 
resonant frequency CD res - The equation of the resonance curve is 

# res (Q i 

I Z 0'«) - j/j +4 e 2 (C0_(O re s) 2 /C0fes 

Owing to the fact that the magnitude of the complex impedance of 
a parallel resonant circuit sharply falls off with an increase in the 
amount off resonance (detuning), this circuit can advantageously be 
used for the frequency filtering of signals. 


Example 9.1. A parallel resonant circuit for which 6 = 125 and 
L = 6 pH is tuned to resonate at / res = 8 MHz. The circuit is driven 
by a harmonic current source; the output signal is the voltage across 
the resonant circuit. Determine the amount by which the signal will be 
attenuated at a frequency of 8.1 MHz as compared with the signal 
magnitude at resonance. 

For tuning to the desired resonant frequency, the capacitor rating 
must be 

C = 1/4tt 2 L/?es = 66 pF 

The resonant impedance of the circuit is 
r ks=p Q=]/l/CQ = 37.69 m 

By virtue of Eq. (9.12), the generalized detuning at 8.1 MHz is 
^ = 2<2A/// re s= 3.125 

Now the amplitude of the output signal is proportional to the 



7.7 7.8 7.9 8.0 8.1 8.2 8.3 


Fig. 9.2 Amplitude response of a parallel resonant circuit with Q — 125, 
L = 6 pH, and C = 66 pF 
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magnitude of the resonant-circuit impedance. Since 

|z|/K res = 1 /i/TTiF 

then, on substituting the found value of we find that the signal 
amplitude at frequency 8.1 MHz is 0.305 times the amplitude at the 
resonant frequency. 

This corresponds to a negative gain (loss or attenuation) 
A = 20 log 10 0.305 = - 10.31 dB 


The amplitude response of the system is shown in Fig. 9.2. 

The specific shape of the amplitude response is an indication that 
the resonant circuit in question is a narrowband frequency-selective 
system. This is true because the ratio of the bandwidth to the 
resonant frequency is 

BW 0 . 707 //res=l/6 = 8 X 10- 3 «1 


Frequently, use is made of tapped parallel resonant circuits. This 
means that the associated external circuit is connected to a tap 
down on the tuned-circuit coil (inductor). The input impedance of 
a tapped resonant circuit is found by Eq. (9.11) in which one inserts 
the purely resistive resonant impedance 


R res — ^t.d P Q 

where fe t .d = T 2 /(L 1 -F L 2 ) is the tapping-down factor with the 
inductive coupling neglected. 

The pole-zero representation of the response of resonant circuits. 

Consider Eq. (9.11) for the complex input impedance of a parallel 
resonant circuit and express the generalized detuning £ in terms of 
the current frequency. Then 


Z (/co) = 


Rres 

1 A jQ (CD/CD r es — COresAo) 


(9.14) 


On changing from the frequency variable yco to the complex fre¬ 
quency p, we obtain the Laplace transform of the tuned-circuit 
impedance 


Z(p) = 


Rres 

1 + Q (p/CDres + ®res/p) 


_ p/C _ 

p 2 + PCOres/6 + CD?es 


The transform Z (p) has an only zero for p = 0 and two complex 
conjugate roots 

Pl,2 = ~ w res/26 ±J ]/1 1/42 2 C0 res (9.15) 

The poles are located in the left-hand half-plane (the system is 
stable), and as their distance to the imaginary axis decreases the 
Q-factor of the system improves. This property is common to all 
frequency-selective systems. 



Connection across part 
of the tuned-circuit 
inductor instead of the 
whole of it brings down 
the resonant impe¬ 
dance without exten¬ 
ding the bandwidth 




Imp 



P*¥r 


The pole Q-factor 
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Fig. 9.3 Small-signal tuned amplifier: (a) schematic diagram; (b) equivalent 
circuit 


Sometimes it is convenient to introduce a special numeric 
characteristic called the pole Q , or Qp 0 ie> defined as the ratio of the 
absolute values of the imaginary and real parts of the pole 
coordinates. As follows from Eq. (9.15), in our case 

Gpoie = |Impi 2 l/|Repi }2 |~ 2<2 

The small-signal tuned amplifier. This system combines the 
functions of an amplifier and of a linear frequency filter (Fig. 9.3). 

It differs from an RC-loaded amplifier (see Chap. 8) in that the 
load is a parallel resonant circuit. Generally, the electron device of 
the amplifier (which may be an electron tube or a transistor) is 
tapped down on, that is, connected across part of, the tuned-circuit 
coil. 

Referring to the equivalent circuit of the amplifier, it is seen that 
the current - g m V in supplied by the controlled source flows 
through an impedance given by 


Z(/co)Rj 

ZeqC/CO) ~ , , p - 

Z(/(D) + Ri 

and produces across it a voltage drop which is the output signal of 
the amplifier. Simple manipulations show [see Eq. (9.11)] that 

Rr 


Z e q(/(0) = 

where 
Rvqs, eq ^ 


v res, eq 

1 +We q 


Rr 


(9.16) 


(9.17) 


1 H" Rres/Ri 

is the equivalent impedance of the amplifier tuned circuit at 
resonance, as corrected for the internal resistance of the source 

1 + Rres/Ri 
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It may be taken that the effect of the internal resistance of the 
source consists in bringing down the Q-factor of the resonant 
system so that it becomes equal to an equivalent Q-factor 


Qeq ~ 


Q 

1 + R T Qs/Ri 


(9.18) 


As follows from Eq. (9.18), in order to minimize the shunting 
effect of the electron device on the tuned circuit without having to 
expand in the bandwidth of the amplifier, one should bring down 
the resonant impedance R res by tapping the electron device down 
on the tuned-circuit coil. Since the complex amplitude of the 
harmonic signal at the amplifier output is 

F out = — 0mZeqFin 

the frequency response of the system is 


^(/^eq) — 9mR res,eq/0 + 7^eq) (9-19) 

Hence, the amplitude response and the phase response of the 
amplifier have the form 


\K(ja)\ = - 


9 m Rres, eq 
^ 46g q (C0-0)res) 2 

(Ores 


(pxN = Jc-arc tail 


2Qeq((0 CD res) 
®res 


(9.20) 


(9.21) 


\ 

A \ 

Work Problem 5 


Example 9.2. For the amplifier shown in Fig. 9.3, / res = 28 MHz, 
Q = 95, p = 430 Q, k t d = 0.6, g m = 20 mA V " \ and Ri = 15 k£l 
Find the gain at resonance and the bandwidth of the amplifier. 
The resonant impedance of the tuned circuit is 

Rres=kldpQ = 0.36 X 0.43 x 95 = 14.17 kft 


The equivalent impedance of the tuned circuit at resonance, as 
corrected for the shunting effect of the transistor, is 


R 


14.71 


res, eq ~ 


1 + 14.71/15 


- = 7.43 kC2 


At resonance, £ e q = 0, so, as follows from (9.19), the gain at 
resonance is 

^res = gm^res, eq 


= 148.6 
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or in decibels 

Ares = 20 log 10 K ves = 43.44 dB 

The bandwidth of the amplifier between the 0.707 points is found 
by Eq. (9.9) 

BW o.707 = /res/2eq == 0.584 MHz 

Multistage frequency-selective systems. The simple narrowband 

circuits we have examined suffer from a serious drawback-a low 
frequency selectivity. This property manifests itself in that outside 
the passband their amplitude response rolls off slowly or, which is 
the same, the rate of cut-off is low. Therefore, the output wave 
contains not only the valid signal whose spectrum lies near the 
peak of the amplitude response, but also a definite, sometimes 
considerable proportion of interfering signals, noise, etc., with their 
spectra lying rather far from the frequency to which the filter is 
tuned. 

One way to improve the frequency selectivity of filters is to use 
several resonant circuits in tandem, so that the overall amplitude 
response is nearly rectangular. 

A simple example of multistage frequency-selective systems is 
a system of two inductively coupled tuned circuits. Its operating 
principle is examined in a course on circuit theory. Figure 9Aa 
shows the schematic diagram of a tuned amplifier loaded into 
a system of two identical inductively coupled tuned circuits. 

The important parameters of this system are the coupling 
coefficient (or coefficient of coupling), k c = M/L , and the coupling 



( a ) ( b) 


Fig. 9.4 Inductively-coupled tuned amplifier: (a) schematic diagram; ( b ) 
plots of amplitude response for several values of the coupling factor 
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factor, A = k c Q. The amplitude response of this amplifier is defined 
as 


\*m= 


^t.d^^m^res, eq 

i/(i+^i 2 - w+w 


(9.22) 


Plots of the amplitude response based on (9.22) are constructed for 
several values of A in Fig. 9Ab. It is to be noted that if A > 1, the 
resonance curve within the pass band has a dip which increases 
with increasing A. If we compare the amplitude responses of 
a single-tuned and a double-tuned amplifier, we will note that, 
given the same Q-factor, the double-tuned-circuit amplifier has 
a resonance curve with a faster rate of roll-off, that is, a better fre¬ 
quency selectivity. 

By using a large number of inductively coupled resonant circuits 
connected in tandem, it is possible to synthesize highly efficient fre¬ 
quency-selective systems. 

A recent trend in communication practice has been to use active 
frequency-selective filters based on novel circuit-engineering 
principles (see Chap. 14). Much headway has been made in the 
design of filters utilizing wave phenomena in solids. This new field, 
called acoustoelectronics, holds out great promise for the synthesis 
of miniature and reliable frequency-selective systems. 

Idealized models of frequency-selective devices. When treating 
frequency-selective systems theoretically, it is advantageous to use 
their simplified models which adequately represent the most 
important aspects of filter behaviour and omit minor details 
which are hard to analyse anyway. 

The simplest model in this class is the hypothetical ideal bandpass 
filter which has a flat frequency response equal to K 0 within the 
pass band: 


{ . K 0 for — co 0 — Aco < co < — co 0 4- Aco 
K 0 for co 0 - Aco < co < co 0 + Aco (9.23) 

0 elsewhere 

Another widely used theoretical model of narrowband systems is 
the so-called Gaussian radio filter for which the amplitude response 
function is a bell-shaped Gaussian curve symmetrical about fre¬ 
quency co 0 . The frequency response of a Gaussian radio filter is 


K (ja a) = K 0 exp [ - b (co + co 0 ) 2 ] + K 0 exp [ - b (co - co 0 ) 2 ] (9.24) 


Here, b is a constant defining the frequency properties of the filter. 
The first term in (9.24) represents a “spike” in the negative-fre¬ 
quency region, and the second term, a “spike” in the positive-fre¬ 
quency region. If bcol»l, the filter is a narrowband one, and no 
overlap occurs between the frequency responses corresponding to 
the negative and positive frequencies. 


The ideal bandpass fil¬ 
ter 



The Gaussian radio 
filter 
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▲ 

Solve Problem 6 


9.2 Response of Frequency-Selective 
Circuits to Broadband Excitations 

It is interesting to know the response of a narrowband frequency- 
selective circuit to a broadband excitation because interfering signals 
are frequently very short pulses. Since the bandwidth of a pulse 
increases as its duration is decreased, the effective bandwidth of 
such interfering signals may substantially exceed the pass band of 
the frequency-selective system involved. 

The concept of broadband signal Let K (/co) be the frequency 
response of a frequency-selective circuit capable of extracting the 
spectral components of the input situated in the vicinity of fre¬ 
quencies ±co 0 . The excitation U[ n (t) with spectrum Si n (co) is called 
broadband with regard to the given circuit, if Si n (co) may be taken 
as being approximately constant within the pass band of the 
system. Then, 

Mout~ ^ in ( j K (/co) exp (/art) dco 
2n 

+ ‘"* in ^ <a °^ f K C/co) exp (/cot) dco (9.25) 

2n o 

As follows from Eq. (9.25), the waveform of the output signal is 
decided by the frequency response of the system , and not by the shape 
of the excitation. The spectrum of the excitation within the pass 
band of the system determines the scale of the response. 

The impulse response of a frequency-selective circuit. A signal 
with an infinitely broad bandwidth is the delta impulse for which 
S in (co)= l. In this case, the output signal is the impulse response 
h(t). According to (9.25), 

1 0 1 00 

h ( t) = —- f K (/co) exp (/cot) dco + — f K (/co) exp (/cot) dco (9.26) 

2 ft _ oo 2 k o 

Consider the first term on the right-hand side of (9.26) 
and replace its integration variable co with a new frequency vari¬ 
able Q: 

co = — co 0 - Q 

This change implies that the frequency response function K (/co) is 
moved from the neighbourhood of the frequency - co 0 into the 
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neighbourhood of the point Q = 0. Therefore, 

1 ° — exp(— j( 0 0 t) 

— | K (/co) exp (/rot) dco =--- 

2n 4 , 2 it 

x J K[-j (co 0 + Q)] exp (- jQt )dQ 

QO 

= eXp( ~ 703 ^ j X [ — / (co 0 + Q)] exp( —jQt) dQ (9.27) 

2ft — CQ 0 

Since the circuit in question is a narrowband one, the amplitude 
response sharply decreases with increasing Q. This means that in 
the last integral of (9.27) the lower limit - co 0 may be replaced with 

— oo: 

1 ? exp ( — /co n 0 

— J K (/co) exp (/cot) dco =--- 

x ] K\_—j (g) 0 + Q)]exp(— jQt) dD (9.28) 

— 00 

Similarly, by a change of variable, oo = co 0 + Q, the second 
integral in (9.26) can be re-cast as 

—f K (/co) exp (/cot) dco = ex Py? . Q _l J K[j (co 0 + Q)] exp (jQt) dQ 
2n J 0 2 k o 

(9.29) 

Since the complex conjugate expressions (9.28) and (9.29) 
combine, the expression*for the impulse response of a narrowband 
system takes the form 


h(t) = 2Re\— J K [/ (co 0 + Q)] exp (jQt) dQ exp (jco 0 t) 


(9.30) 


The low-frequency equivalent of a frequency-selective network. 

This refers to an imaginary system whose frequency response is 
obtained by shifting that of a real narrowband network from the 
vicinity of frequency co 0 into the neighbourhood of zero frequency, 
that is, 


Klf(/Q) = .K[/(coo + fi)] (9-31) 

The integral in (9.30) is the impulse response of the 1 f. equivalent 
hi({t) = j— J K if(/fl) exp (jdt) dQ (9.32) 
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h 


Therefore, 




The typical impulse 
response of a frequen¬ 
cy-selective network 


h ( t ) = Re [2h\f(t) exp (/co 0 £)] 


It follows then that the function 2h\f(t) is the complex envelope of 
the impulse response of a real narrowband network. As follows 
from (9.33), the impulse response of a frequency-selective system is, 
in the general case, a quasiharmonic wave the envelope and initial 
phase of which vary slowly in time (on the time scale T = 2n/(o 0 ). 


Example 9.3. The If equivalent of a parallel resonant circuit. 
Here, the frequency response of the system is its complex input 
impedance 


Z (/©) = - 


Rr 


. 2Q (CO — COres) 


(9.34) 


1+7 


COr 


The frequency response of the 1. f. equivalent can be obtained by 
a change of variable co = co ! es + Q in (9.34): 


Z(jQ) = 


Rr 


1+7 


. 2QQ 


G>res 


(9.35) 


To within the scale factor R res , this is the frequency response of 
a lst-order dynamic system (similar to an RC-network) with a time 
constant 


'Cckt— 2()/C0res 


(9.36) 


m 

The tuned-circuit time 
constant 


called the tuned-circuit time constant . 

The impulse response of such a network has been found in Chap. 
8 when examining the properties of the RC-network: 

h\f(t) = (Rres/Xckt)exp( - t/tckt) for t> 0 (9.37) 

Thus, the impulse response of a parallel resonant circuit is 

h(t) = (i?res<*W2) ex P( - tAckt) COS ffl res t (9.38) 

Since 

Rresft>res/C2 = 1/C 

where C is the resonant-circuit capacitance, the result thus obtained 
fully checks with that found in Example 8.20. 

Example 9.4. Find the impulse response of an idealized narrowband 
system whose frequency response is 

K (/co) = R 0 exp [ - b {co - co 0 )] ct(cd - co 0 ) 

for co > 0. 
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On shifting the above function into the vicinity of zero frequency, 
we obtain the frequency response of the 1. f. equivalent 


K if (jQ) = K 0 exp ( - bQ) a (£2) (9.39) 

Hence, the corresponding impulse response is 

h\i(t) = ^2- J exp [ - (b -jt) Q] dQ = K 0 /2k (b -jt) (9.40) 

2tt o 

It is to be noted that h\f(t) is a complex-valued function. There¬ 
fore, the l.f. equivalent of the filter in question is not a physically 
realizable network. This, however, does not stand in the way of 
obtaining the impulse response of the original system by use of Eq. 
(9.33): 


h(t) = Re 


n(b-jt) 


exp0'co o 0 


n 


1 


(b cos co 0 £ — t sin co 0 £) 


Example 9.5. Find the impulse response of the double-stage tuned 
amplifier whose schematic diagram is shown in Fig. 9.5. 

Assume for simplicity that the two stages are tuned to the same 
resonant frequency co re s ? have the same gain at resonance K TQs , and 
the same tuned-circuit time constant x c kt- Then the frequency 
response of the amplifier is 

Tf 2 

K (/ra) = --;---ry 

[1 + 7^ckt(® — ®res)] 

Hence, 


X lf (/-Q) = X 2 res /(l+7^ckt) 2 

On replacing the frequency variable jQ. with the complex fre- 



Fig. 9.5 Two-stage amplifier (the circuit components printed in black 
perform auxiliary functions): R l through R 4 apply initial bias to transistors 
Tj through T 4 ; C b -d.c. blocking capacitor 
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Fig. 9.6 Impulse response of a two-stage tuned amplifier 
quency p, we get 

Kl{(p) = K 2 res /( 1 + pick,) 2 = (xyx 2 k 0/(p + 1/Tckt) 2 

From tables of Laplace transform pairs we find that the above 
transfer function corresponds to the impulse response 

/iif(t) = (KresAlct)texp( - r/Tckt) 

Hence, the impulse response of the two-stage amplifier is 

h (t) = (2 K ? e <Ackt) (t/x ckt) exp ( - t/x c kt) cos (o res t (9.41) 

A plot of the impulse response is given in Fig. 9.6. 

It is instructive to compare this result with the impulse response 
of the single parallel tuned circuit in Example 8.20. As is seen, the 
output pulse is “pulled” in time because of the appreciable time lag 
associated with a double-tuned-circuit system. 

The general case Suppose that a frequency-selective system is 
driven by an arbitrary broadband signal whose spectrum is 

S in (co) = A(co)+7 *J3 (co) 

Let u[ n (t) be a real function. Then 
A (co) = ^4 ( — co) and B{ co)= —B( — co) 

Let us write the output wave as a sum: 

«out W = WoutM + juoit(t) (9-42) 

Here, 

Mout(t) = A( '~ l 0) — f K0'co)exp(/©£)d(o 

v4 ffD 1 00 

H-— J K (/©) exp (/cot) dco 

2n o 

= 2^4 (co 0 ) Re exp (/co 0 t)] 


(9.43) 
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Similarly, 

u ( out(t)= B(< j K (/co) exp (/cot) dco 

-00 

+ f x (/co) exp (/cot) dco 

2k o 

= j2B (co 0 ) Im Of(t) exp (/©oO] 

Substituting (9.43) and (9.44) in (9.42) finally yields 


Uout(t) = 2 {A (®o) Re [liif(t)exp (/© 0 t)] 
- B (ct> 0 ) Im exp (/<V)]} 


(9.44) 


A 

Work Problem 7 


(9.45) 


As a special case, Eq. (9.33) describing the impulse response of 
a narrowband network naturally stems from (9.45). 

The physical significance of the spectral expansion. Assume for 
simplicity that h\f(t) is a real function, and write Eq. (9.45) as 

WoutW = 2/iifM V A (co 0 )cos co 0 t - B( co 0 )sin co 0 f] 

= 2h\ ( (t))/A r +B i cos (co 0 t -h cp) (9.46) 

where cp = arc tan (B/A) and }/ A 2 -h B 2 = |-Si n (co 0 )|. 

Thus, we may conclude that the response of a narrowband 
network to a broadband signal is proportional to the absolute 
value of the spectrum of the excitation at the point on the fre¬ 
quency axis correspondingTo the central frequency of the network’s 
pass band. 

This suggests an approach to the hardware implementation of 
signal spectrum analysis. Figure 9.7 shows the block diagram of the 
parallel type of spectrum analyzer. 

The spectrum analyzer shown in Fig. 9.7 consists of a number of 
narrowband filters whose passbands do not overlap. By measuring 
the amplitudes of the output waves simultaneously, it is possible to 
obtain information about the intensity of the spectral components 
of the input signal at some points along the frequency axis. 

The above principle of spectrum analysis implementation is of 
important significance both practically and theoretically. Among 
other things, it brings out the physical significance of the behaviour 
of the signal spectra examined in Chap. 2. For example, it has been 
found that the spectrum of a rectangular video pulse of duration x 0 
is zero at all frequencies co„ = 2nn/T p (n = 1, 2, ...). Suppose that this 
video pulse drives a very narrowband resonant network tuned to 
one of these frequencies. The ratio of the natural period of the 
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Fig. 9.7 Block diagram of a signal spectrum analyser. (The amplitudes of 
the filter outputs are proportional to the magnitudes of the spectra.) 


network to the pulse duration: T n — 2n/(£> n —tp/n is an integer. On 
being driven by the leading edge of the input pulse in one direction, 
the system will be “kicked” by the trailing edge of the same pulse in 
the opposite direction in a time which is a multiple of the network’s 
natural period. As a result, the two responses will cancel each other. 
Precisely this occurrence is corroborated by the zero values of the 
spectrum of the video pulse at some points along the frequency 

axis. . . 

An excellent presentation of material on the physical aspects ol 

spectral expansion will be found in [7]. 


The cause of signal 
distortion in frequen¬ 
cy-selective systems 


9.3 Response of Frequency-Selective 
Circuits to Narrowband Excitations 

In a typical situation, such as in the reception of modulated 
signals, a frequency-selective linear filter is driven by a valid signal 
the spectrum of which has a well-defined peak within the pass band 
of the filter. As a rule, the resonant frequency of the tuned circuit is 
the same as the carrier frequency (symmetric tuning). 

If the spectrum of the input signal were strictly bounded to the 
frequency band within which the frequency response of the filter 
remains constant, the output signal would be a scaled replica of the 
input signal. However, both the amplitude response and the phase 
response of a frequency-selective network are far from ideal, and 
this leads to distortion in the waveform of the output signal. 
A method by which one can determine signals at the output of fre¬ 
quency selective systems driven by narrowband waves is set forth 

Basic relations. Let us consider an arbitrary narrowband network 
whose frequency response K (/co) is substantially nonzero only in 
the vicinity of points + co 0 on the frequency axis. Suppose that the 
excitation is a narrowband (quasiharmonic) wave whose central fre¬ 
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quency is co 0 . This means that in the equation 

u[n{t) = Re [(7 in(t) exp(/co 0 f)] (9.47) 

the complex envelope U m (t) varies more slowly than the wave 
cos co 0 t. Let the correspondence between the signals and their 
spectra be designated as 

U inW 4 "* G i n (co) 

such that (see Chap. 5) the spectra of the excitation and of its 
envelope are connected by a relation of the form: 

Sin(co) = G in (CO - C0 0 ) + y G? n ( ~ CO - C0 0 ) 

Hence, by using the fundamental equation of the spectral 
method, we obtain the following expression for the output signal: 

1 0 

M° ut W = 4^7 J G* in ( - co - co 0 ) K (/co) exp (/cot) dco 


1 00 

+ — | Gin (co - ®o ) K 0'®) exp (/cot) dco (9.48) 

471 o 

By a change of variable, co = — co 0 — £2, in the first integral, we may 
re-write it as 

1 0 

-t— f Gi* ( “ co — co 0 ) K (/co) exp (/cot) dco 

471 —*oo 


I 00 

= 4 ^- G,*n (£2) K [ - j (CD# + O)] exp ( - jilt) dQexp ( - ja 0 t) (9.49) 

Similarly, on inserting co = co 0 4- Q, the second integral in (9.48) 
may be re-written as 

1 00 

— J Gj n (co - co 0 ) K (/co) exp (/cot) dco 
471 o 

= ~ ] Gi n (Q) K [J (co 0 + Q)] exp (jilt) d£2 exp (/co 0 t) (9.50) 


In taking the sum of the right-hand sides of (9.49) and (9.50), it is 
to be noted that the two expressions are complex conjugates of 
each other. Also, on the basis of Eq. (9.31), the term K [/(co 0 + Q)] 
is the frequency response of the l. f. equivalent of a narrowband 
network. Therefore, 


^out(0 — Rs 


2n 


CO 

j Gi n (Q) K\f(jQ) exp (filt) dQ exp (/co 0 t) 

— 00 
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Hence, the expression for the complex envelope of the output 
signal is 

U 0 ui(t) = 4~1 G in(^» Kim) exp ( iQt) d Q (9.51) 

It should be interpreted as follows: The complex envelope of the out¬ 
put signal is a slowly varying wave whose spectrum is 


G 0 ut(0) = Gin(n)KifOQ) 


(9.52) 


u in 


A lf UQ) 


U out 


In order to find the output signal of a frequency-selective 
network driven by a narrowband signal, we should first determine 
the response of the l.f. equivalent of the original network to the 
complex envelope of the excitation. The final step will then be to 
recover the physical output signal: 


Mout(t) = Re [ G out (t) exp (/'©o 0] ( 9 - 53 ) 


Equation (9.51) corresponds to the spectral (frequency-domain) 
method of finding the output signal of an l.f. equivalent. Other 
methods, such as the Laplace transformation and the Duhamel 
superposition integral, may be used as well. In accord with the 
Duhamel superposition integral method, 

Uout(t)= 1 U in (t) h\({t — t) dx (9.54) 

— OO 

where /iif(t) is the impulse response of the l.f. equivalent. 

Response of a single-stage tuned amplifier to an AM signal. We 

seek to find the response to a single-tone AM wave 

Min (r) = U 0 (1 + M cos *2t) cos © 0 t (9.55) 


of a single-stage tuned amplifier whose frequency response is 


K (/'©) = 


_~ K res _ 

1 + /t c kt(© ©res) 


(9.56) 


Let us adopt an important simplifying assumption that the 
resonant frequency © res and the carrier frequency © 0 are the same. 
The complex envelope of the input signal is 

U in (t) = U 0 (1 + M cos £2t) (9.57) 

The frequency response of the l.f. equivalent of the amplifier is 

K 0*2) = - W(1 +7*2r c kt) ( 9 - 58 ) 


The complex envelope of the output signal may be found from 
(9.57) and (9.58) by the usual method of complex amplitudes known 


Ch. 9 Response of Frequency-Selective Systems to Deterministic Signals 


277 


from circuit theory: 


K res U 0 M 

Uom(t) = - K ies U 0 - ° cos (Qt - 3) 

yi + Q 2 x 2 ckt 

where 0 = arc tan £2x c kt. On substituting this expression in (9.53), 
we finally obtain 


u out(t) — ~ ^res^o 


1 + 


M 


j/l + £2 2 

Since the tuned-circuit time constant is 


‘Tckt 


cos (Q,t — 0) 


cos co n t 


^ckt — 2Qres/^res 

the above relation may be re-cast as 


Wout(t)— —KresU 0 


1 + 


M 


l/TT^ 


cos (Q,t - 0) 


COS CO 0 t 


(9.59) 


where ^n= 2g r es^/ c °res is the generalized detuning of the amplifier 
tuned circuit at the upper side frequency. 

Thus, the wave appearing at the amplifier output is likewise an 
AM signal, but boosted in amplitude. It differs from the input 
signal in that it has a smaller modulation factor (or modulation 

depth). Solve Problem 8 


M 0 ut=M in /j/l + ^ 


(9.60) 


Also, the envelope of the output signal is delayed from the envelope 
of the input signal by a time £d = $q/Q. 


Example 9.6. Let an AM-signal of M — 0.8, co 0 = 5 x 10 6 s “ 1 and 
£2 = 3 x 10 4 s -1 drive an amplifier tuned to the carrier frequency. 
The equivalent Q-factor of the amplifier is Q eq = 75. 

In this case, 

^q= 2 x 75 x 3 x 10 4 /5 x 10 6 = 0.9 
Hence, by virtue of Eq. (9.60), 

M out = 0.8/]/l + 0.81 = 0.595 

As is seen, the depth of modulation is substantially reduced. 
Because arc tan 0.9 = 0.733 rad, the envelope is delayed for a time 
£d = 0.733/(3 x 10 4 ) = 24.43 ps. 


Response to a truncated voltage sinewave. In many 
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▲ 

Solve Problem 9 

m 

The rise time of 
oscillatory system 


communication systems (radar, multichannel radio links, etc.), the 
useful information is transmitted by means of sequences of 
rectangular radio pulses. On passing through resonant frequency- 
selective networks which are integral parts of the respective 
receivers, these input pulses are somewhat distorted. In order to 
assess the degree of distortion, let us determine the output signal of 
a single-stage tuned amplifier whose frequency response is given by 
(9.56), when the input signal is 

l>in(t)= Pm cos Wo to (t) 

If (Ores = © 0 , then, on taking this frequency as reference, we 
obtain the following expression for the complex envelope: 

Fin (t)=V m a{t) (9-61) 

The effect of the signal defined in (9.61) on a system whose fre¬ 
quency response has the form of (9.58) has been examined in Chap. 
8 in connection with the step response of an RC-network. There¬ 
fore, by taking advantage of the already known result, we may 
write 


FoutW = - Kres F m [1 - exp( - t/Xckt)] C> (t) 

Hence, the output signal of the amplifier is 

(9.62) 

l>out(0 = - Kres F m [l - exp( - t/x ck t)] COS CO 0 t 

(9.63) 


The plot corresponding to (9.63) appears in Fig. 9.8. 
an The instantaneous amplitude of the input signal reaches 0.9 times 
its steady-state value, K res F m , over the time interval known as the 
rise time 


Tr = 2.303 Tckt — 4.606<2eq/tores 


(9.64) 


Voi^t / (^resF m ) 



t !Tckt 


Fig. 9.8 Transient response of a tuned amplifier tuned to the signal 
frequency 
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The effect of detuning. Now we will consider the previous 
problem in a more general form on assuming that the frequency of 
the harmonic signal differs from the resonant frequency of the 
tuned circuit by an amount 5co: 

L’in(t) = F m COS [(C0 res + M t] 

and 

Fin (0= F m exp(/6cot)a(t) 

The simplest way to find the output signal from the 1. f. 
equivalent of a single-stage tuned amplifier is to use the Duhamel 
superposition integral in which the impulse response of the 1. f. 
equivalent 

hit)= - (KresAckt)exp( - t/x ckt )cr(r) (9.65) 

is inserted. 

On the basis of Eq. (9.54), we find 

Fout (t) = - XresK -1 exp (/Scot) exp [ - (t - x)/x ckt ] dx 
'tckt o 

= ^ - es V ~ [exp (/Scot) - exp (- t/x c kt)] (9-66) 

1 + yocGXckt 


The physical envelope of the oscillatory waveform appearing at 
the output of a tuned amplifier is described by the magnitude of the 
complex output envelope 


Fout(0=|K)ut(0l : 


-^res Km 


l/l +?5cox ckt ) 2 


y 1 — 2exp( — i/x ck ,)cos Scot + exp( — 2 t/x ckt ) 


(9.67) 


The plots constructed by Eq. (9.67) for several values of tfye 
detuning 5co appear in Fig. 9.9. 

Thus, the difference between the resonant frequency of the tuned 
circuit and the harmonic carrier frequency of the output signal 
results in nonmonotonic variations in the envelope of the output 
signal. 

The physical interpretation of this fact is this: The output signal 
of an amplifier is the sum of the forced (or steady-state) response 
which has the frequency of the external source, and the free (or 
transient) response which exponentially decays with time and has 
a frequency equal to the natural frequency of the tuned circuit. For 
the duration of the output signal, the phasor kf r ee rotates at the 
difference frequency relative to the phasor kforced- The envelope of 
the output signal, proportional to the length of the resultant phasor 
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Pout /(Kres Pm) 


tl Tckt 


0.6 

0.4 

0.2 



Summation of the free 
(transient) and forced 
(steady-state) waves 


Fig. 9.9 Transients in a tuned amplifier under detuning: ( 1) for 5©x ckt = 1; 
(2) for 5cQT ckt = 3 

Vl, is time-varying, tending in the limit to the amplitude of the 
forced (steady-state) response. 

Interestingly, as the output approaches its steady state, the 
instantaneous frequency of the output signal is varying, too. Using 
Eq. (9.66) and taking advantage of the method for finding 
instantaneous frequency values set forth in Chap. 5, we get 

CO (0 = cores + “77 *rg Pout (0 


d 

= cores + -T" arc tan 
at 


sin 5cot 

cos 5co t - exp( - t/xckt) 


(9.68) 



# 

PSK signals 


Naturally, at t->oo, when the transients in the amplifie have 
practically died out, the frequency of the output signal becomes 
equal to the frequency of the excitation. 

Response of a tuned amplifier to a phase-shift-keyed (PSK) drive. 
As already noted, communication services frequently use truncated 
harmonic waves whose initial phase undergoes abrupt changes at 
discrete instants. This form of modulation is known as phase-shift 
keying (PSK), and the corresponding signals are referred to as PSK 
signals. 

Let us take a closer look at the response of a single-stage tuned 
amplifier to PSK signals, assuming that the excitation experiences 
a change of phase by cp 0 radians at t = 0: 


f coso) res f for t< 0 
Vm (0 Pm | cQs ^ (0res t _|_ ^ f Qr t > 0 

The complex envelope corresponding 
V\n ( t) = V m [a (- 0 + exp 0'cpo) (0] 


(9.69) 

to the above signal is 

(9.70) 
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Using the Duhamel superposition integral, we find the complex 
envelope of the output signal: 

K>utM =— — — J [ct(- T) + exp0'(po)a(T)] 

Tckt — oo 

x exp [ - (t - x)/x ckt ] dx (9.71) 

For t < 0, it follows from Eq. (9.71) that 

F O ut(0 =— KkS Vm ~ 1 exp [ - (f - x)Ackt] dx = -K [es V m (9.72) 

Tckt — oo 

which implies that prior to the jump in phase the amplifier is in 
a steady state. On the other hand, for f>0 

Fout(f)= - Kres V — J exp [ — (t — x)/x c kt] dx 

^ckt — oo 

^ckt o 

= - Kres Pm {exp ( - t/ T c kt) 

+ expC/cpo) [1 - exp(- r/x c kt)]} (9.73) 

It is to be noted that for t = 0 Eqs. (9.72) and (9.73) yield the 
same result: 

Vout (0) = — Kres V m 

If, however, t/x c kt»l, then 

Pout(0 - - Kres Pm exp 0‘(po1 

that is, when all transients have died out the system goes into 
a new steady state which differs from the previous one by a phase 
shift of cp 0 radians. 

From Eq. (9.73) we may write the following expression for the 
physical envelope of the output signal for t> 0: 

FoutW = K ies V m {[e + (1 - e“ t/tckl )cos cp 0 ] 2 

+ (l_ e -‘A° k fsin 2 cpo} 1/2 (9.74) 

In practical PSK, use is often made of a phase shift of 180°. Then 
lout ( t ) = Kres Vm | 2 exp ( — t/ Tckt) — 1 | (9.75) 

Here the amplitude of the output signal goes to zero at time t 0 
which is the root of the equation 

2 exp (- foAckt) -1=0 


PSK with a phase 
shift of 180° is espe¬ 
cially convenient for 
the transmission of 
binary-coded messages 



























282 


Part Two. Circuits 


Pout /(^res Pm) 



Fig. 9.10 Signal envelope at the output of a tuned amplifier driven by 
a phase-shift-keyed signal: (1) for (p 0 = 180°; (2) for cp 0 = 90° 


Hence, 

t 0 = 0.693xckt (9-76) 


The instability of in¬ 
stantaneous frequency 
is undesirable 


The dependence of the physical envelope of the output signal on 
the dimensionless parameter t/x c kt for two values of the phase shift 
(p 0 , 180° and 90°, is shown in Fig. 9.10. 

The physical behaviour of the output signal is due to the 
interference of the free and forced oscillations. 

It is to be noted that the transients arising in an amplifier in 
response to a PSK signal are accompanied by variations in the 
instantaneous frequency. On the basis of Eq. (9.73) 


CO (t) = cores + — arc tan - 

nt 


(1 -e' 

~ c/r C kt i (i 


-t/x c 


‘) sin cp 0 

-^CktWo - 


(9.77) 


Response of a resonant system to an angle-modulated signal. An 

exact solution for the response of a narrowband frequency-selective 
network to an FM or a PM excitation is difficult to obtain. The 1. f. 
equivalent method set forth in this chapter only permits us to for¬ 
mulate the problem. Thus, if the input to a single-stage tuned 
amplifier is a simple single-tone angle-modulated wave 


vin (t) = Vm cos (cd 0 t + m sin Q t) 


whose complex envelope is 
Vin ( t ) = V m exp (jm sin Qt) 

then the complex envelope of the output signal can be described by 
the following Duhamel superposition integral 

Pout (t) = — KveS Vm ~ J exp (Jm sin fix) exp [ — (t — x)/x c kt] dx (9.78) 

'tckt — oo 
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(It is assumed that co 0 = (Ores.) Since the integral in (9.78) has 
a varying upper limit, it cannot be evaluated exactly. The problem 
can be solved approximately, if we assume that the instanteneous 
frequency of the input wave varies so slowly that the oscillatory 
system can “follow” its variations. Then the envelope of the output 
signal will be proportional to the magnitude response at the 
instantaneous frequency: 


|KO)| = 


*res 

]/1 T- Xckt (CO — Ores) 2 


(9.79) 


On inserting co = co r es + wQ cos Q,t , we obtain the following equation 
for the envelope of the output signal: 


Fout(f) — 


*res I'm 

]/1 + (mQx c kt) 2 cos 2 f2t 


(9.80) 


Thus, the passage of an FM or a PM signal through 
a carrier-tuned resonant amplifier is accompanied by a parasitic 
amplitude modulation. If mQx c kt«l, then the following 
approximate expression stems from (9.80): 

Vout ( t ) « *res V m [1 - y (mftx c kt) 2 COS 2 Qt] 


= K 


res 



(mQxckt) 2 

4 


(mfitckt) 2 


cos 2 £lt 


(9.81) 


It means that the envelope* spectrum includes the second harmonic 
of the modulating frequency and, if the frequency deviation is large 
enough, also the higher even harmonics. 

The instantaneous-frequency method permits us not only to 
analyse variations in the amplitude of FM and PM signals, but also 
to find the variations caused in the signal by the oscillatory system T , . f 

of the amplifier itself. To this end, we note that the total phase of e ins an t ^ n ^.° US " re 
the output signal is the sum of that of the input signal ( l uenc y me 0 

^in = GV + w sin 

and the phase shift due to the phase response of the amplifier: Solve p ro 5 j em |q 
q*K (o>) = ~ arc tan (co - co res ) x c kt (9.82) 

On inserting the instantaneous frequency of the input wave 

COin = (Ores + OlD COS Qt 

in Eq. (9.82), we get the total phase 'Pout and the corresponding 
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The spectral composi¬ 
tion of the instanta¬ 
neous frequency at the 
output of a narrowband 
system 



m 

Narrowband groups 


instantaneous frequency co 0 ut of the output signal: 

'Pout = co 0 £ + m sin Q.t — arc tan (mQx c kt cos Zlt) (9.83) 

_ _ micict Q 2 sin Q.t 

«w, = dT om /d< - <0. + -a cos n< + 1 + (mS! , ckiCosQ ;)r < 984 > 

Now we assume that the product of the frequency deviation by 
the tuned-circuit time constant b = m£2x c kt«l and expand the last 
term on the right-hand side of (9.84) into a power series. On 
retaining the first term of the series, we obtain 

co out = co 0 + m£2 cos Q,t + Qb sin Q.t — Clb 3 sin Q.t cos 2 Qt 

By simple trigonometry, we finally get 


©out = co 0 + mQ cos Q t + Qb (1 — 6 2 /4)sin Q,t — (Qfr 3 /4)sin 3 £lt (9.85) 


As follows from Eq. (9.85), the instantaneous frequency of the 
output signal contains not only the in-phase component mflcosQt 
which is present in the input signal, but also a small quadrature 
component which is proportional to sinQt. From its presence we 
conclude that the signal embedded in the instantaneous frequency 
has been shifted in time. In fact, the above equation includes one 
more component which varies at three times the modulating fre¬ 
quency. It is a manifestation of the distorting effect that 
a narrowband network has on the useful message embedded in the 
current values of the instantaneous frequency. Fortunately, under 
the assumptions that we have made this detrimental effect is 
negligible. 

The role of the phase characteristic of a network. Before we 
conclude our overview of the properties and characteristics of linear 
stationary networks, it is important to see how the phase response 
of a system affects its output signal. 

For better insight into the fundamental aspects of the phenomena 
involved, let us consider a case where the excitation is the sum of 
two harmonic waves. Each has an amplitude of unity, and their fre¬ 
quencies, ©! and oo 2 , are chosen such that their difference is small: 

| COi — C0 2 |/C0i «1 

Analytically, the input signal may be written as 

/OL-CQ, \ / 00,4-0)2 

^in(0 = cos ©it + cosco 2 t = 2cosI--- 1 Jcosf--- 1 1 (9.86) 

The energy of the aggregate process is concentrated in time as 
individual “portions” called narrowband or quasiharmonic groups. 
The smaller the difference in frequency between the two input 
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waves, the more these groups are extended in time. The low-fre¬ 
quency term, 2cos^ C ° 1 ^ ( ° —^ in Eq. (9.86) is the group envelope. 

A narrowband group may be looked upon as one of the simplest 
elements that make up a wave having a more complicated spectral 
structure. 

Let the signal defined in (9.86) be applied to a linear stationary 
system whose frequency response is 

K (/©) = I K (yco) | exp [/< p K (©)] (9.87) 

Suppose that within the frequency interval (g^, cd 2 ) the magnitude 
of the frequency response is a constant, K 0 . Then 

v 0 ut (0 ~ K o {cos [ov + y K (co x )] + cos [a> 2 * + cpx (^ 2 )]} ( 9 - 88 ) 


The phase response of the system can be expanded into a Taylor 
series about the point (o 1 : 

dcpx 

9 k (® 2 ) = 9 k (® i ) + -^-( C0 2 -© 1 ) + ••• 


Retaining only the linear term of the expansion, we get 
Vout (t) X K 0 {cos [co, t + <p/cK)] + cos [©it + Amt 

+ <Pk(©i) + -^^^®]} 


= 2K 0 cos 


Aco 

( t + d(p * Y 1 

~2' 

l dco jj 


cos + y Aftrt 


+ cp/c(© 1 ) + y^lfAco] 

Here, Aco = co 2 — cc^. It immediately follows that the envelope of 
a quasiharmonic group at the output of the system is shifted in 
time from the envelope of the input signal by an amount equal to 
| dcpx/dG) |. If this derivative is negative, the envelope of the output 
signal is delayed by a time 


T g = -dcpft/d© 


(9.89) 


Solve Problem II 


Group (or envelope) 
delay time 


called the group (or envelope) delay time. The derivative must be 
taken at an arbitrary point within the frequency interval where the 
bulk of the energy of the narrowband signal is concentrated. 

The group (or envelope) delay time is a convenient measure of 
the delay that narrowband signals experience on passing through 
sluggish linear circuits. 
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Example 9.7. A rectangular r.f pulse of duration x p = 20 ps and 
with a carrier frequency f 0 = 10 MHz is applied to a carrier-tuned 
single-stage resonant amplifier. The equivalent Q-factor of the tuned 
circuit is Q eq = 40. Find the delay time of the output pulse relative to 
the input wave. 

The spectrum of the input signal is concentrated in the frequency 
interval (f 0 — 1 /t p ,/ 0 + l/x p ), that is, between 9.950 and 10.050 MHz 
(the spectrum width is taken between the zeros of the main lobe of 
the spectrum diagram). The bandwidth of the amplifier is 

BW 0 . 707 =/ res /e eq = 250 kHz 

Approximately, it may be taken that the input pulse in our case is 
a narrowband signal whose delay time may be evaluated by Eq. 
(9.89). Using the equation of the phase response 

9 k M = “ arc tan x c kt (co - a> re s) 


t 



we get 

Tg|( 0 =G) res = Xckt = 2Qeq/cores = 1.27 JiS 


Summary 

A salient property of narrowband frequency-selective systems is the fact that for them 
the ratio of the bandwidth to the centre (midband) frequency is small. These networks 
are used for the frequency filtering of band-limited signals. 

Physically, frequency-selective networks can be realized as high-Q resonant circuits, 
both single- and multistage. 

^■0* The input signal will be broadband with respect to a frequency-selective system if its 
spectrum may be considered constant over the pass band. 

<x> The low-frequency equivalent of a narrowband network is an imaginary system whose 
frequency response is obtained by translating the frequency response of the original 
network into the neighbourhood of the zero frequency. 

The impulse response of a narrowband network is a narrowband wave whose 
instantaneous frequency is close to the central frequency of the passband. 

The complex envelope of the impulse response of a narrowband network is 
proportional to the impulse response of the low-frequency equivalent. 

<0^ Frequency-selective networks can be utilized for experimental spectrum analysis in 
which the response of a frequency-selective network to an arbitrary broadband 
excitation is measured in order to trace the frequency dependence of the signal 
spectrum. 

Instead of seeking a complete solution defining the response of a frequency-selective 
network to a narrowband signal, it will suffice to tackle a simpler problem in which 
one determines the response of the low-frequency equivalent of the original network 
to the complex envelope of the input signal. 

If the central frequency of the passband and the carrier frequency are the same, 
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a narrowband network will reduce the modulation depth of an AM input signal. 

00 When a single-stage tuned system is driven by a truncated sinewave, the envelope of 
the output process rises to 90% of its final (steady-state) value in a time x r = 
= 4.606 QeqA&res- 

OO If there is a difference between the resonant frequency of a tuned circuit and the 
carrier frequency of the driving pulse, the envelope of the output signal will vary 
nonmonotonically in time. The instantaneous frequency at the output will vary, too. 

OO The passage of a PSK signal through of a narrowband tuned amplifier produces time 
variations in both the envelope and the instantaneous frequency of the output signal. 

OO In an elementary form, the response of narrowband networks to FM and PM inputs 
can be determined only on the assumption that the product of the input frequency 
deviation by the system time constant is sufficiently small (the instantaneous-frequency 
method). 

OO A frequency-selective network is responsible for spurious amplitude modulation of 
FM and PM output signals, and also for the appearance of the 3rd harmonic of the 
modulating frequency in the instantaneous frequency spectrum. 


Review Questions 

1. What is the convention for defining the bandwidth of narrowband electric networks? 
What is the attenuation, in decibels, of the signal at the boundary of the bandwidth? 

2. What is the condition for the amplitude response of a single-stage resonant system to be 
symmetrical about the resonant frequency? 

3. What is the typical order of magnitude for L, C and R res in parallel resonant circuits 
with a resonant frequency of several tens of megahertz? 

4. Define absolute, relative and generalized detuning. 

5. Plot a typical location of the transfer-function poles of a narrowband system in 

a complex plane. Can the plot be used to find the Q-factor of the system? 

6. What is the tapping-down of a tuned circuit? List the salient features of a tapped tuned 

circuit. 

7. How does the internal resistance of an electron device affect the behaviour of 

a small-signal tuned amplifier? How can one mitigate the resultant detrimental effect? 
Write equations for finding (1) the gain at resonance and (2) the bandwidth of the 
amplifier. 

8. What is the advantage of a coupled-circuit amplifier over a single-stage tuned amplifier? 

9. List the factors which can, in your opinion, determine the upper frequency limit at 
which a tuned amplifier is still operable. 

10. What is the meaning, absolute or relative, of the concept of broadband signal? 

11. Is it necessary for the low-frequency equivalent of a narrowband system to be 

a physically realizable network? 

12. Construct an approximate plot for the impulse response of a narrowband system. Note 
the condition for physical realizability. 

13. What is the time constant of a resonant circuit? 

14. What is the difference between the impulse responses of a single-stage and a two-stage 
amplifier? 

15. Define the physical meaning of the spectral expansion of a signal. 

16. How should the bandwidth of a tuned amplifier be chosen so that AM signals can be 
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satisfactorily passed in practice? Where do the requirements for the shape of the 
amplitude response of frequency filter come in conflict? 

17. What factors decide the rise time of a single-stage tuned amplifier? 

18. Explain in physical terms the rise of the output of a single-stage tuned amplifier to its 
steady-state value when the amplifier is driven by a truncated voltage sinewave. What is 
the role played by the free (transient) response of the amplifier? Why is it that initially 
the output signal is small? 

19. Do the same for a PSK input signal. Why is it that the output frequency does not 
remain constant during transients? 

20. Define the rationale of the instantaneous-frequency method. 

21. Construct an approximate plot of the wanted signal that can be extracted from the out¬ 
put wave of a single-stage resonant system, assuming that the input signal is 
a single-tone FM signal. 

22. Define the group (envelope) delay time. What should the phase response of a system be 
like for the applied signal to suffer a minimum of distortion? 


Problems 

1. Define the value of generalized 
detuning for which the slope of the 
amplitude response of a resonant circuit is 
a maximum. 

2. A parallel resonant circuit has 
a resistance of 30 kD at the resonant fre¬ 
quency of 20 MHz, while the magnitude of 
its impedance at a frequency of 21 MHz is 
18 kD. Find the element values of the tuned 
circuit. 

3. Find the frequency response and the 
impulse response of the low-frequency 
equivalent of an ideal bandpass filter. Hint : 
see Eq. (9.23). 

4. Work the previous problem as applied 
to a Gaussian radio filter. Hint : See Eq. 
(9.24). 

5. In the small-signal tuned amplifier of 
Fig. 9.3, the tapping-down factor for the 
tuned circuit in the collector lead of the 
transistor can be varied by shifting the tap 
along the tuned-circuit coil. Find the 
relation between the voltage across the 
tuned-circuit capacitor and the 
tapping-down factor. 

6. A Gaussian radio filter [see Eq. (9.24)], 
for which K 0 = 10, oo 0 = 10 6 s ~ 1 and b = 


= 5 x 10" 10 s 2 , is driven by a rectangular 
video pulse of 25 V amplitude and 0.2 ps 
duration. Verify that for the filter in 
question the input signal may be classed as 
broadband. 

7. A single-stage tuned amplifier, for 
which /res = 6 MHz, Q eq = 40 and K T e s = 35, 
is driven by an exponential video pulse of 
voltage (V) 

vin(t) = 0.3exp( - 4 x 10 7 t)c t(t) 

Find the output signal of the amplifier. 

8. A series resonant circuit is driven by 
a source of emf (V) 

Vm(t) = 5 x (1 + 0.8cos4 x 10 3 f)cosl0 6 t 

The resonant circuit is tuned to resonate at 
the carrier frequency. Find the Q-factor of 
the tuned circuit at which the current 
modulation factor is 0.4. 

9. Analyse distortions in the envelope of 
rectangular radio pulses on passing through 
a single-stage tuned amplifier in which the 
tuned circuit has Q eq = 60. The carrier fre¬ 
quency (2 MHz) of the input signal is the 
same as the resonant frequency of the tuned 
circuit. 
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10. Define the law of time variations in 
the instantaneous frequency of the output 
signal from a single-stage tuned amplifier 
driven by a voltage wave 

V{ n (t) = V 0 cos(2n\0 6 t + 0.1 cos27il0 3 t) 

The amplifier tuned circuit is tuned to the 
carrier frequency of the input signal and has 
a time constant of 10“ 5 s. 

11. A tuned amplifier has two stages 
tuned to the same frequency of 12 MHz. 
The Q-factor of the tuned circuit in the 1st 
stage is 40, and that in the 2nd stage is 50. 
Find the group (envelope) delay time for 
a narrowband signal whose centre frequency 
is 12.2 MHz. 


Advanced Problems 

12. Find the response of a tuned amplifier 
to a single-tone AM signal when the carrier 
frequency co 0 differs from the resonant fre¬ 
quency co res of the tuned circuit. Show that 
the difference between the two frequencies 
leads to a parasitic angle modulation of the 
output signal. Assuming that the relative 


detuning, | co 0 — co res |/co 0 , is small, derive an 
equation for the parameters of the parasitic 
modulation. 

13. Investigate the response of a single- 
stage amplifier to an excitation whose 
instantaneous frequency undergoes a step 
change at t = 0: 

f F 0 cosco 0 t for t< 0 
Vm 1 1 K cos K + S°°) t for t > 0 


Assume that 0L> res = co 0 . Find the expression 
describing variations in the envelope and 
instantaneous frequency of the output signal. 

14. Suppose a tuned amplifier consists of 
identical stages. Derive the equation defining 
the rise time of the system as a function of 
the number N of stages, stage time constant 
Tckt, and resonant frequency co res . The input 
signal is a truncated voltage sinewave at fre¬ 
quency co 0 = cores. Hint: Take advantage of 
the fact that 


N — 1 


1 1 


~p{p + af a N 


1 — exp ( 


-“’I 

m= 0 


(at)" 


ml 
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Chapter 10 

Response of Linear Stationary 
Networks to Random Signals 


In the previous two chapters, we dealt with methods which 
permit solving any problems involving the passage of deterministic 
signals through linear stationary systems. The final step in the 
theory of linear systems is to extend the above methods to random 
signals. 

Suppose that we have a linear stationary network driven by 
a wave x(t) which is a realization of a random process X(t). If this 
realization is specified in advance, no new problem will arise-the 
signal x(t) may be treated as a sufficiently deterministic function, 
although it may be described in a fairly complicated manner. Once 
we know the mathematical model of a system, which may be 
defined in terms of, say, the frequency response K(/co), we can 
always find the system’s response y(t). 

A salient feature of statistical communication theory is, however, 
the fact that so full an information about the input signal is not 
available - instead of a deterministic description of the input signal 
we have to be content with the statistical averages of the random 
process X(t). These statistical averages are the univariate and 
bivariate probability densities and various moment functions, above 
all the expectation and the autocorrelation function of the random 
process. Our objective is to investigate the association between the 
processes X(t) and Y{t) that can be defined on the basis of the fre¬ 
quency response of the system involved. 

10.1 Spectral Analysis of the Response of Linear 
Stationary Circuits to Random Signals 

From the outset it is essential to impose an important 
constraint-we shall deal solely with wide-sense stationary input 
processes X ( t ). As will be recalled, this implies that the expectation 
(mean) of the instantaneous values of realizations, x, is 
time-invariant, whereas the autocorrelation function K x (t 1 ,t 2 ) = 
= x(t 1 )x(t 2 ) — x 2 depends solely on T = \t 1 —1 2 \, the absolute 
difference between observation times (points on the time axis). 

To simplify matters in our subsequent discussion, we shall always 
put x = 0. This will not limit the generality of reasoning and 
conclusions. Owing to the linearity of the circuits in question, the 
effect of the constant (d. c.) component in the input signal on the 
response of a system can be analysed independently and, 
importantly, without recourse to statistical procedures. 

The mean of the output signal. Let us take an individual 
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realization x(t) of the input signal and represent it as a Fourier 
integral 



oo 

S*(co)exp(/cot)dco 


— OO 

Here and elsewhere the realization is assumed to be such that its 
spectrum does exist, at least in the form of a generalized function. 

The output signal of the system can be found, if we know its fre¬ 
quency response 



00 

j* (co) K (/co) exp (/cot) do) 


( 10 . 1 ) 


— OO 

When changing from an individual realization to a complete 
ensemble of input signals, we should take S*(co) as a random 
function and recall that the assumption of stationarity (see Chap. 7) 
of the process X(t) imposes ri gorou s conditions: The mean of the 
spectrum is equal to zero, S x (co) = 0. Therefore, on averaging 
statistically both sides of Eq. (10.1), we get 


y 


1 

2n 


00 

S x (m)K (/co) exp (/cot) dco = 0 


( 10 . 2 ) 


— 00 


Averaging is done over 
an ensemble of reali¬ 
zations 


The autocorrelation function and the power spectrum of 
a random output signal. In order to find the autocorrelation 
function Ky(i ), we should, in addition to the spectral expansion 
(10.1), also have an expression for the output signal at the time t + 

+ T - lt can be found on the basis of the properties of the Fourier 
transform: 


y(r + x) = 


1 

2tu 


oo 

/» 

S x (co') K (/co') exp (/co't) exp (/co't) dco' 


— 00 


(10.3) 


There is a small (and, indeed, an unimportant) point related to the 
computational technique: the function y(t) is real, and so Eq. (10.3) 
will remain unaffected if we pass to complex-conjugate quantities 
on its right-hand side: 


y(t + T ) = 

2n 


00 

S|(co') K* (/co') exp (-yco'x) exp (- /co't) dco' 


— 00 


(10.4) 


The autocorrelation function of the output signal can now be 


10 * 
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The filtering property 
of the delta function 
is utilized 


Relation between the 
input and output power 
spectra of a system 


found by multiplying together the signals defined by Eqs. (10.1) and 
(10.4) and averaging the product statistically: 


OO 


Ky{x) = y(t)y(t + i) = 



— 00 


S x (co) S * (cd') K (yco) K * (/co') 


x exp (- jco'x) exp \j (co - co') t] dco dco' (10.5) 

At first glance the above equation may seem hopelessly complicated 
to be analysed. But it should be borne in mind that the input 
random process in question is stationary, and so (see Chap. 7) the 
random spectra of its individual realizations are delta-correlated, 
that is, 

S x (co)S$(co') = 2 ttPE x (co) 6(co - co') (10.6) 

where W x { co) is the power spectrum (or the power spectral density) 
of the stationary random process X(t). From this remarkable fea¬ 
ture in the structure of the input signal spectrum, we can readily see 
the simple meaning of Eq. (10.5): 

00 

K y (x) = Y n | I K (/co) | 2 exp( -jon) da 

— 00 

or equally 


00 


— 00 


W x (co) I K (/co) | 2 exp (/cox) dco 


(10.7) 


In effect, Eq. (10.7) contains a complete solution to our problem in 
terms of correlation theory: The power spectrum of a random output 
signal is related to that of the associated input signal as follows: 


Wy(«t) = IEx(co) | K (/co) | 2 


( 10 . 8 ) 


In applied problems, one has often to deal with one-sided power 
spectra, F x (f) and F y (f), which are defined solely for positive fre¬ 
quencies / in hertz. Obviously, 

F y (f) = F x (f)\K(j2nJ)\ 2 (10.9) 

and so the variance of the output signal 

v 2 y = K y (0) = ] F x (J)\K(j2nJ)\ 2 df 
o 


( 10 . 10 ) 
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is the result of combining the contributions from the power spectrum 
of the input signal multiplied by the frequency-dependent square of the 
magnitude of the frequency response, that is, by the power transfer 
function. 

The manner in which to handlejhe problems falling in the class 
examined here is already well known to us-it involves the 
evaluation of Fourier integrals by a variety of techniques. Therefore 
in the examples that follow we shall concentrate not so much on the 
mathematical aspect of the matter, as on the physical features of the 
processes concerned. 



Example 10.1. The response of an integrating RC-network to white 
noise . 

Suppose that a first-order dynamic system schematically depicted as 
an integrating RC-network, is driven by a source of noise emf whose 
power spectrum W 0 (V 2 s) is constant at all frequencies. Find the 
variance and the autocorrelation function of the output voltage y (t). 

To begin with, we find the power transfer function of the network 
in question: 


\K(jco)\ 2 = 


1 

1 + co 2 (RC) 2 


Now, on setting x = 0 and using Eq. (10.7), we find the variance of 
the output noise: 


▲ 

Work Problems 1 
and 2 


00 



dco 

1 + co 2 (RC) 2 


= W 0 /2RC 


( 10 . 11 ) 


- o 

As should be expected, the variance of the output signal decreases 
with increasing time constant of the network, because this entails 
a reduction in the band of frequencies effectively passed by the 
network. 


The autocorrelation function of the output signal is 
exp (/cox) dco 




1 + co 2 (RC) 2 


( 10 . 12 ) 


Here, 

00 

exp (/cox) dco 


= 2 


cos cox dco 


1 + co 2 {RC) 2 1 + co 2 (RC) 2 

— oo 0 

The last integral is tabulated [40], so taking advantage of the fact, 
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we obtain 


K y (x) 


W 0 

2RC 


exp 



(10.13) 


Naturally, at zero-crossings the autocorrelation function is equal to 
the variance of the output signal. 

To sum up, when an integrating RC-network is excited by white 
noise, the response is a random process having an exponential 
autocorrelation function. 

Importantly, since it is sluggish in response, the RC-network 
effects a kind of “ordering”: Whereas the input signal is absolutely 
unpredictable because it is white noise, the output signal is 
smoothed; its correlation time is of the same order of magnitude as 
the time constant of the network. 

Example 10.2. The response of a single-stage tuned amplifier to 
white noise. 

Suppose that a small-signal tuned amplifier is driven by 
a source of white-noise voltage having the one-sided power 
spectrum F 0 (V 2 Hz -1 ). The frequency response of the system is 


K(j2nf) = 


K r , 


1 jlKX ckt if— /res) 


and the power transfer function is 


\K(j2nf)\ 2 = 


K 


2 

res 


l+47T 2 T? kt (/'-/ res ) 2 


Finding the variance reduces to evaluating the integral in 

( 10 . 10 ): 


G y — F pK 2 QS 


df 


1+4tt 2 t 2 kt (/-/ re 


Now we change the variable, r\=f -/ res , and assume that the 
tuned circuit of the amplifier has so high a Q-factor that the 
frequency response for /= 0 may be taken equal to zero. 
Then, 


&y — F 0 K tqs 


dr| 


1 + 47c 2 T? kt ri 


" — F o^res/2T ck t 


(10.14) 
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A typical realization 
of a random signal at 
the output of a tuned 
amplifier 


A 

Solve Problem 4 


Finally, the autocorrelation function of the output signal is 
cos cox dco 


Ky(T) = 


F 0 K 2 e s 
2n 


1 + Tc kt (© - Oh, 


FqK 2 qs r COS (Q + (Q res ) x dQ 


2k 


F pKres 


2n 


COS CO res T 


1 + xikt& 

00 

cos Qt dQ 


1 + x 2 kt Q 2 


2x c kt 


exp(- | T|/T ckt ) COS COresT 


(10.15) 


As is seen, the autocorrelation function thus obtained has the 
form 

Ky(T) = CT^p(x) COS C0 res x (10.16) 

which is typical of a narrowband random process, because the 
envelope p(x) = exp( — | t |/x ckt ) is a slowly varying function in 
comparison with the h. f. carrier. 

Any realization of the random process at the output of 
a narrowband amplifier is a quasiharmonic wave with a random 
envelope and a random instantaneous frequency; on the average, 
<he carrier frequency is equal to the resonant frequency of the tuned 
circuit. This behaviour of the output signal can readily be 
understood if we note that the signal results from combining a huge 
number of elementary responses each of which is proportional to 
the impulse response of the system (the Duhamel superposition 
integral principle). 

In order to get an idea about the order of magnitudes involved in 
statistical communication, let us estimate the variance of noise at 
the output of a tuned amplifier under the following conditions: 
F 0 = 10 - 16 V 2 Hz - \ K res = 30, Ores = 10 8 s - \ and Q e q = 60. The 
time constant of the tuned circuit is x ckt = 2geqAo r es = 1.2 ps. 
Therefore, on the basis of Eq. (10.14), 

a 2 = 10 ~ 16 x 900/(1.2 x 10 “ 6 ) = 7.5 x 10 - 8 V 2 

The rms value of noise voltage, equal to the square root of the 
variance, is 274 pV. 

Example 10.3. Consider a network composed of two RC-sections 
between which an ideal amplifier of gain K 0 is interposed: 
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Let the system be excited by a source of noise emf having a power 
spectrum constant at all frequencies (white noise). Find the 
autocorrelation function of the output signal. 

The power transfer function is 


K 2 0 


\ K m\ 2 - {l+0) 2 x 2 m&0) 2 x 2 2) 

In accordance with Eq. (10.7), finding the autocorrelation function 
for the output voltage reduces to evaluating the integral: 


Ky( T) = 


W 0 K 2 


exp (/cox) do 


2n J (I + co 2 xf)(l +co 2 t|) 


(10.17) 


— oo 

It is advisable to resort to the theory of residues and to take the 
same route as was used in Chap. 8 in analysing the impulse 
response of an RC-network. The integrand function in (10.17) has 
four simple poles at points co 1>2 = ±j( 1/xJ and co 3>4 = ±j(l/x 2 ). 

We will evaluate the function K y (z) for x>0 by closing the 
contour of integration in the upper half-plane. The residue of the 
integrand function at point is 


res 1 ^= 0 )= - 


exp (/cox) 


——[(1 -I- co 2 xf)(l H- co 2 xi)] 
dco 


co= ©i 


T 1 exp(-r/x 1 ) 

2/(t?-tS) 


In a similar way, we find the residue for point co = a> 3 lying 
vithin the contour of integration 

— x 2 exp( — x/x 2 ) 


res | co= co 3 


2/(xf - x|) 

Hence, by virtue of Cauchy’s residue theorem, we obtain 

(10.18) 


K v (x) = 


W ° K ° - [t x exp (- x/xj - t 2 exp (- t/t 2 )] 


2(t 2 i-t 2 2 ) 



for x > 0. 

We can obtain the autocorrelation function for x<0 from the 
same equation on replacing x with - x. This stems from the fact 
that the autocorrelation function is an even function. However, the 
result can be confirmed by direct calculation, if we close the path of 
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A 

Solve Problem 6 


The white noise trans¬ 
formed by one RC- 
network 



and by two RC- net¬ 
works connected in 
series 


integration with an arc of an infinite radius in the lower half of the 
complex co-plane. 

Thus, 

W K 2 

K.vfr) = 2 ° ° 2 ~r [x t exp(— Ixl/xJ-x^xp)- |x|/x 2 )] (10.19) 

Z(Xi — x 2 ) 

The variance of the output signal is 


v 2 y = K y ( 0) = 


WpKl 
2(x t + x 2 ) 


Therefore, the correlation coefficient is 


( 10 . 20 ) 


Ry(j) = ---[Xi exp( — | x | /x x ) — x 2 exp(— |x|/x 2 )] (10.21) 

T 1 - T 2 


The results obtained by Eq. (10.21) for two values of the ratio 
t 1 /t 2 are plotted in Fig. 10.1. For comparison, the same figure 
shows a curve which represents the correlation coefficient of 
a random process at the output of a single integrating RC-network 
with time constant x^ It is interesting to note not only the increase 
in the correlation time due to the addition of a second time-lag 
element, but also the changed behaviour of R y (x) for the 
two-section filter in the vicinity of point x = 0. The fact that the 
autocorrelation function has a second derivative at that point 
assures the differentiability of the output random process (see 
Chap. 7). Physically, the differentiability of the output signal 
^implies the smoothness of the realizations of the signal that has 
passed through two RC-networks connected in cascade. 


R y 



Fig. 10.1 Correlation coefficient for a random process at the output of 
a system consisting of two RC networks: ( 1 ) for x 2 = x 1 /2 and (2) for Xj = x 2 
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Response of a network to broadband random signals. The noise 
bandwidth of a network. Frequently one is concerned with the 
response of linear circuits to very broadband random signals 
formed by, say, a chaotic series of short pulses. In such cases, there 
is every ground for considering the spectral characteristics of the 
noise only within the bandwith of the system, with the real random 
process replaced by an equivalent white noise having a one-sided 
power spectrum F 0 = F x (f 0 ), where f 0 is a point within the 
bandwidth of the network. 

In the circumstances, Eq. (10.10) which defines the variance of the 
response can be simplified as 

G 2 y = F 0 ]\K(j2Kf)\ 2 df (10.22) 

0 

In engineering calculations, a linear circuit excited by 
a broadband random signal can conveniently be characterized in 
terms of its noise bandwidth, BW n (Hz). It is defined as the 
bandwidth of an ideal bandpass filter whose frequency response is 
^max> that is, equal to the maximum magnitude of the frequency 
response of the real network. When an ideal system is excited by 
white noise with a power spectrum F 0 , the variances of the noise 
signals at the output of the ideal and the real networks must be the 
same 
00 

MIX ( j2vf ) 1 2 d/= Xo^maxBW n (10.23) 

0 

Hence, 


BW n = 


1 


-Kmax 


I K (j2nf) | 2 df 

* 

0 


(10.24) 


As an example, for an integrating RC-network: 

Kmax = 1; I K (j2nf) | 2 = 1/[1 + 4n 2 f 2 (RC) 2 ] 

Therefore, 

00 

bw "-ItMw- i/4rc <io ' 25) 

0 

It is to be noted that for the network in^question the magnitude 
of the frequency response decreases to l/]/2 of its maximum value 
at /o .707 = l/2tt RC. Therefore, the noise bandwidth is wider than 

BWq.707 : 
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The noise bandwidth of a single-stage tuned amplifier is found in 
a similar way: 


BW n = 


df 


1 + 4jt 2 t4t(/—/res) 2 


-=l/2x ckt = 1.571 BW 0 


707 


(10.26) 


The example that follows will demonstrate how the concept of 
noise bandwidth can be used in engineering calculations. 


Example 10.4. A single-stage tuned small-signal amplifier for which 
^res = 85, 6eq = 70, and / res = 0.7 MHz, is excited by a source of 
stationary noise emf x(t) for which the autocorrelation function (V 2 ) 
is 

K x (t) = 0A5 exp ( — (31 x |) 

where (3 = 10 7 s -1 . Find the rms noise voltage at the amplifier 
output. 

To begin with, we invoke the W-K theorem in order to find the 
power spectrum of the input signal: 

°° 00 

w x(<o) = J X x (T)exp( -joy/dr = 2 ct 2 J exp( - (It) cos cot di 

- 00 o 

This type of power spectrum has already been found in Chap. 7. 
Taking advantage of that result, we may write for the case on hand: 

2cyB 

!fx(fi>) = , = 0.9 x 10 7 /(10 14 + co 2 ) 

(3 2 + co 2 ’ 

The one-sided power spectrum is 

Fx{f) = 2W x (2nf) = 1.8 x 10 7 /[10 14 + (2rc/) 2 ] 

Noting that the power spectrum is a maximum at zero frequency, 
whereas at co = 10 7 s " 1 it is only half as great, we conclude that 
within the bandwidth of the amplifier the input signal may be 
replaced with an equivalent white noise whose power spectrum is 

A f o = 7 r x(/'res)= 1.508 xl0- 7 V 2 Hz- 1 

Solve Problem 8 The bandwith of the amplifier between the 0.707 points is 

BW 0 707 =/res/2eq = 10 kHz 

The noise bandwidth is 

BW n = (jt/ 2)BW 0 707 = 15.708 kHz 

On substituting the numerical values thus found in Eq. (10.23), 
we obtain that 

ct 2 = 1.508 x 10 ~ 7 x 85 2 x 15708 = 17.11 V 2 































300 


Part Two. Circuits 


Hence, the rms value of noise voltage at the amplifier output is 
o y = ]/17.11 = 4.14 V 


A 

Solve Problem 5 


Normalization of a random signal at the output of a linear 
stationary network. So far we solved all problems within the 
framework of correlation theory, that is, by invoking at most 
second-order moment functions. More completely the problem 
could be stated like this: The input random process is specified by 
giving a family of its nth-order multivariate probability densities 
p n (x l9 ..., x n \ t l9 ..., t n ). Given the frequency response K(/co), it is 
required to determine the corresponding probability densities for 
the output process. 

In the general case, the solution of such a problem is a highly 
complicated matter and is not considered in this book. Fortunately, 
however, we may often expect that the output signal will be 
Gaussian, irrespective of the probability density of the input 
process. 

The normalization of the output signal is inherent in any 
stationary linear system if it displays a sufficient time lag (or 
memory). The point is that in accord with the Duhamel 
superposition integral 

t 

y(t) = J x (x) h (t — t) dx 

— 00 

the instantaneous value y(t) is the result of the weighted summation 
of the previous values of the input signal x(t\ multiplied by the 
time-shifted impulse response (the weighting function) of the 
network. If the duration of the impulse response is such that it 
spans several correlation times of the input random process, the 
conditions for the applicability of the Central Limit Theorem (see 
Chap. 6) are realized. As a consequence, the output signal shows an 
asymptotic normality. If, on the other hand, the input random 
process is normal, the random process at the output of the system 
will be normal, too, irrespective of the dynamic properties of the 
system. 

Thus, the techniques of correlation theory are quite adequate for 
solving most problems involving the response of linear stationary 
circuits to random signals. 

10.2 Sources of Fluctuation Noise 
in Circuit Components 

This closing section of Chapter 10 will be concerned with the 
physical phenomena that stand behind fluctuation voltages and 
currents in circuits. We will also derive the relations that are used 
to assess the intensity of noise. 
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Thermal noise in resistors. The most common cause of noise is 
the fluctuation of the bulk density of electric charge in conducting 
bodies (resistors) in turn brought about by the chaotic thermal 
motion of charge carriers. Although the system as a whole is 
electrically neutral, time-varying electromagnetic fields are produced 
in the bulk of the resistor, and a noise potential difference is 
produced across the external terminals. The noise voltage has an 
extremely wide spectrum because the charge carriers are very 
densely packed and the mean thermal velocity is high. In view of 
this, it is legitimate to think that at radio frequencies the thermal 
noise voltage across a resistor is an approximate realization of 
white (delta-correlated) noise. 

The Nyquist law. Let us derive the relation for the power 
spectrum of the noise voltage between the terminals of a resistor 
R which is in thermal equilibrium with the surroundings at 
absolute temperature T. To this end, we mentally connect the 
resistor in parallel with a capacitor C and replace the real noisy 
resistor with a series combination of an ideal noise-free resistor 
R and an e.m.f. source producing white noise. It is required to 
determine the power spectrum W 0 of this noise. 

Statistical mechanics tells us that when a system is in thermal 
equilibrium, its thermal energy is so distributed among the degrees 
of freedom that each takes on an average amount equal to kT/2 
(where k = 1.38 x 10 " 23 J K " 1 is Boltzmann’s constant). This 
statement is known as the Law of Equipartition of Energy. Since the 
network we are considering is a first-order dynamic system with 
one degree of freedom, the average electric-field energy stored in the 
capacitor is exactly kT/2 , that is, 

Cvf!2 = kT/2 

and so the variance of the noise voltage across the capacitor is 
a 2 = v% = kT/C 

Now we will use Eq. (10.11) which relates the variance to the 
power spectrum of the noise voltage. Since 

W 0 /2RC = kT/C 

the auxiliary quantity C cancels out, and we get 
W 0 = 2kTR 

Practically, it is more convenient to use the one-sided power 
spectrum defined for the positive frequencies and having the units 
of V 2 Hz" 1 : 


F 0 =4kTR (10.27) 


1 


A 

® © @ 

V®j 
® 4> 


B 

© 

©?~e 
© e* © 



7 


The charge in region 
A is not equal to that 
in region B due to 
the chaotic motion of 
the carriers 



▲ 

Solve Problem 7 
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▲ 

Solve Problem 10 



The best performance 
is achieved when the 
front-end circuits of 
receivers are cooled to 
the liquid-helium tem¬ 
perature (T=4.2 K) 



Specific brightness 


This remarkable relation, known as the Nyquist Law , was proved in 
the late 20s. 

It is to be stressed that F 0 has the simple and clear physical 
singificance of the specific variance of the thermal noise source, that 
is, the variance per frequency band of 1 Hz. 

The order of magnitude for the power spectral density of thermal 
noise can be assessed from the following example. For T = 300 K 
and R = 10 kC2, F 0 will be 1.66 x 10“ 16 V 2 Hz -1 . Hence, the 
specific rms noise voltage is 1.29 x 10“ 8 V Hz“ 1/2 . Although it 
appears very small, thermal noise may well be a decisive factor in 
limiting the actual sensitivity of receivers. 

It is interesting and important to note that the noise power that 
can be transmitted into an external resistive load is independent of 
R. To demonstrate, consider a system in which an ideal filter with 
a passband of 1 Hz is placed between R and Ry. As will be recalled 
from circuit theory, the power transferred into load is a maximum 
when R = Rl (the matching condition) and is equal in our case to 

E sp = ^/4 R = kT(WUz~ 1 ) (10.28) 

Accordingly, the only effective way to minimize thermal noise is 
to cool the input circuits of sensitive receivers used in radar, radio 
astronomy and deep-space communications to very low 
temperatures. 

Noise in receiving antennas. In communication equipment an 
important and, sometimes, the decisive source of noise may be 
chaotic fluctuations of electromagnetic fields generating noise 
voltage at the output terminal of a receiving antenna. 

Let an elementary receiving antenna (a Hertzian dipole) of length 
/ be oriented along the z-axis and placed inside a closed space 
whose walls are at a temperature T. 

By the Planck law, the closed space is filled with an equilibrium 
electromagnetic radiation characterized by a special spectral 
parameter known as specific brightness and having the units of 
W m “ 2 Hz “ 1 srad “ 1 : 

B= c 2 [exp(hffkT) - 1] (1 °- 29) 

where c is the velocity of light, / is the frequency in Hz, and h = 
= 6.62 x 10 “ 34 J Hz “ 1 is Planck’s constant. Specific brightness is 
a flux of electromagnetic radiation per Hz, incident at a given point 
from within a solid angle of 1 steradian. 

If hf« kT (which is typical of radio frequencies), then Eq. (10.29) 
transforms into an approximate relation known as the 
Rayleigh-Jeans radiation formula 

B = 2 kT/X 2 


(10.30) 
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where X = c/f is the wavelength. 

Let us include the quantity 

Esp = Ex , sp + Ey ? S p + E 2 , S p 

which is the mean square of the electric field strength E per Hz. It 
is proved in the theory of electromagnetism that in the 
circumstances the radiation power flux (W m“ 2 ) is 

£ 2 p/1207r = £ 2 S p/407r 

The above expression takes into account the fact that becau se all 
the spatial directions are equally significant, £ 2 p = 3£ 2 5 sp. By 
dividing the power flux into 4 tt, that is, by the solid angle of the 
entire space, we obtain an expression for brightness in terms of field 
quantities: 

B = Elsp/\60n 2 (10.31) 

On equating the right-hand sides of Eqs. (10.30) and (10.31), we 
find the specific mean square of the electric-field component which 
is oriented along the antenna: 

e|s P = 320n 2 kT/X 2 (10.32) 

Since the voltage induced across the terminals of the antenna 
(which is short in comparison with the wavelength) is v = El, the 
specific variance of the output voltage is found to be 

v 2 p = 3207T 2 (l/X) 2 kT (10.33) 

If we introduce the so-called radiation resistance (12) of a Hertzian 
dipole 

jRe = 80tc 2 (l/X) 2 

then Eq. (10.33) transforms into the Nyquist equation for an 
elementary receiving antenna: 

^lp = F 0 = 4kTRx (10.34) 

Here T is the temperature of the equilibrium medium through 
which electromagnetic waves are propagated. This fully holds only 
for noise of cosmic origin. As measurements have shown, the 
“coldest” regions of the sky have a temperature of several kelvins. 
On the other hand, the temperature in the direction of radio 
galaxies and other natural sources of radio noise emission may be 
as high as 10000 K. As far as atmospheric interference of terrestrial 
origin is concerned, here the bulk of noise power is concentrated at 
frequencies below 30 MHz. In order to retain Eq. (10.34) unchang¬ 
ed, one has to introduce the noise temperature T n which is fre¬ 
quency-dependent. The spectral composition of atmospheric 
interference is such that at frequencies of the order of 1 MHz the 
noise temperature may sometimes be as high as 3 x 10 8 K. 


Electric field strength 
has the dimensions 
of V nr 1 


A 

Solve Problem 11 
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Shot noise derives its 
name from the re¬ 
semblance that it bears 
to that of fine shot 
falling on a surface. 


A 



Pulse overlap 


The above reasoning 
also applies to the 
injection of carriers in 
semiconductor devices 


Shot noise. In this case, very common in electronic circuits, noise 
is generated due to the passage of discrete charge carriers. In 
contrast to thermal noise, the fluctuations in this case arise not 
from the chaotic thermal motion of electrons, but owing to the 
statistical independence of carrier motions in electron devices 
(tubes, crystal diodes, transistors, etc.). 

As an example, consider a thermionic (hot-cathode) diode in 
which a current is caused to flow by a source of constant e. m. f. 
This current takes the form of a chaotic stream of electrons each of 
which carries a charge e = 1.6 x 10 “ 19 C. The time for the transit 
of an electron from the cathode to the anode is x t « 10 " 9 s. During 
this interval, a short pulse of the so-called convection current is 
registered in the external circuits of the diode. The charge thus 
transferred by each electron is the electronic charge e and so: 

T t 

j *con d t = e 
o 

Hence, we estimate that z con a 1.6 x 10~ 10 A. 

Ordinarily, the diode current is a few milliamperes, so the pulses 
of convection current densely overlap in time. 

Electrons are emitted by the cathode at statistically independent 
instants. Hence it is clear that the instantaneous value of anode 
current does not remain constant-it experiences certain fluc¬ 
tuations. In this sense, an electron device acts as a source 
of a special kind of noise which has come to be known as shot 
noise . 

Poisson distribution. Let v designate the average number of 
electrons arriving at the anode every second. Experiments have 
convincingly proved that this numeric characteristic is statistically 
constant, that is, stationary. The d. c. component of anode current is 
connected to the parameter v by a simple relation 

I 0 = ev 

The number v is very large: for 7 0 = 1 mA it is estimated to be 
^ 10 16 s ~ 1 . 

Before we analyse the process statistically, we will make 
a simplifying assumption, of minor importance physically, but 
facilitating calculations: Suppose that in their travel from cathode 
to anode electrons follow one another singly, so that the probability 
of electrons arriving at the anode in twos, threes, and so on, is 
negligible. 

From the discrete mechanism of the process, we may legitimately 
consider that if A is the arrival of an electron at the anode in the 
interval (t, t + At), then, to within small terms of the order of (At) 2 , 
the probability of this event is given by 

Pa = vAt (io.35) 
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Let P 0 (f) designate the probability that no one electron will 
arrive at the anode during the time interval from zero to t. Then 
P 0 (t +At) will be the probability of a complex event: Not a single 
electron will arrive at the anode in either the interval (0, t) or in the 
interval (t, t + At). According to the properties of the probability of 
a compound event, we have 

P 0 (t + At) = P 0 (t) (1 — vAt) 

By passing to the limit for At->0, we obtain the differential 
equation 

dP 0 /dt = -vP 0 

subject to the obvious initial condition P 0 (0) = 1. The solution of 
the equation is elementary: 

P 0 (t) = exp(- vt) 

Since v 10 16 s “ \ the probability that not a single electron will 
arrive at the anode during the time interval of 1 s long will be 
exp(— 10 16 ), which may legitimately be taken as the probability of 
an improbable event. 

Let us analyse the probability P 1 (t) that exactly one electron 
arrives at the anode. In the time interval (0, t + At) this probability 
is the sum of the probabilities of two disjoint events: 

(a) an electron arrives in the interval (0, t); 

(b) an electron arrives in the interval (t, t + At). 

By the rule for the addition of probabilities, 

P t (t + At) = P 1 (t)( 1 - vAt) + P 0 (t) vAt 

Hence, we obtain the following differential equation: 

dP 1 /dt = - vP 1 + vP 0 


A complex (or com¬ 
pound) event is formed 
by two or more inde¬ 
pendent events 


subject to the initial condition P 1 (0) = 0. 

In a similar way, we obtain a solution for the initial-value 
problem involving the arrival of exactly n electrons at the anode: 


f dP n /df = - vPn + vPn-i 

[Pn(0) = 0 


(10.36) 


By direct substitution, we find that 
(vt) n 

P n (t) = ^exp(-vt) (10.37) 

n\ 


Equation (10.37) defines the Poisson distribution which is 
encountered in many problems of statistical communication theory. 
If an experiment yields a Poisson-distributed whole-numbered 



The Poisson distribu¬ 
tion 
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variable, variations from the mean in either direction will occur 
rarely on any one trial. 

Moments of a Poisson-distributed random variable. Let us 

choose a time interval T and count the average number of electrons 
arriving at the anode: 

00 00 

(vD" V (vT )" -1 

ni-^-exp( —vT) = vTexp(-vT) \ (H _ 1); - = vr 

n =0 n =1 

(10.38) 

The meaning of the above equation is simple to see: It confirms the 
original supposition that v is the mean arrival rate of electrons. 
Now let us find the mean square of the number of electrons 
arriving during the chosen time interval: 

nfr = ^n 2 Lfhexp(-vT) 

n = 0 

oo 

(vT)" 

[n(n — 1) + n]-exp(-vT) 

n ! 

n = o 

00 

= vT+ (vT) 2 V ( , VT) * exp( - vT) = vT+ (vT) 2 (10.39) 

Zj ( n — 2 ) ! 

n = 2 


Using Eqs. (10.38) and (10.39), we obtain the variance of the 
number of arriving electrons 


c>n = n\- ( n T ) 2 = vT 

(10.40) 

Statistical properties of the diode current. Now let us determine 
the current flowing through a thermionic diode. If a number n of 
electrons arrives at the anode over a time T, then the current ir 
over the observation interval will be defined by 

ir = en/T 

The mean value of the observed current is 


I 0 = iT= (e/T)ri T = ev 

(10.41) 

and the variance of the current is 
= (e 2 /T 2 ) On = (e/T) I 0 

(10.42) 


If we choose to measure the intensity of current fluctuations in 
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terms of the ratio of the rms value to the mean value, then 

°i/I 0 = VejT,'V% (10.43) 

The conclusion stemming from Eq. (10.43) is this: The relative 
fluctuations of tie diode current fall off with an increase in both the 
observation time and the mean current. 


Example 10.5. Let I 0 = 10 2 A and the observation time T= Is. 
Then the variance of the current over the observation time is 
of = 1.6 x 10 ~ 21 A 2 

and the current through the diode will be 
i= 10 ~ 2 + 4 x 10“ 11 A 

It is seen that the relative fluctuations of current are very small. 
If we substantially reduce both the mean current and the 
observation time by putting I 0 = 10“ 8 A and r=10 _8 s, then 

<j? = 1.6 x 10“ 19 A 2 


Work Problem 12 

i= 10“ 8 + 4 x 10“ 10 A 

that is, the relative fluctuations of current build up markedly. 

The above example explains why we do not notice the random 
oscillations of the pointer of a moving-coil instrument connected in 
series with a thermionic diode. Here, the current being measured is 
averaged over a time interval of about one second due to the 
sluggishness of the mechanical system of the instrument. 


Schottky’s equation. The shorter the observation time T, the 
broader the bandwidth that has to be considered in the spectrum of 
the process. By Kotelnikdv’s theorem, for a system to be able to 
process a signal over a time T, the system must pass all frequencies 
up to the frequency /max such that 

T= 1/2/max 

Taking advantage of thix in Eq. (10.42), we get 

&i = 2c I of max 

Hence, the specific variance of the fluctuating current, that is, the 
variance per hertz of the frquency band, A 2 Hz -1 , is 


i 2 sp =2el 0 (io.44) 


In radio engineering, this important relation has come to be known 
as Schottky’s equation. According to it, the equivalent noise circuit 
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of any electron device contains a current source producing white 
noise with a power spectrum defined by Eq. (10.44 
Experiments show that the power spectrum of shot noise in 
electron devices remains flat (that is constant) up to frequencies of 
several hundred megahertz and then begins to decrease with rising 
frequency. This is because at very high frequencies jor, which is the 
same, at small values of T), the adopted noiss model, which 
requires a sufficiently large number of electrons to arrive at the 
anode over the observation period, is no longer valid. Also, the 
decrease in the power spectrum of noise due to tie finite duration 
of the elementary convection current pulse begins to take effect. 

Example 10.6. A single-stage RC-coupled transistor amplifier has 
the following parameters : R l = 5.1 kQ, Cb = 45 pF, and Ri= 20 kQ. 

The Q-point is located on the transistor characteristic so that the 
direct component of the collector current is I 0 = 1.5 mA. Find the rms 
output noise voltage due to the shot effect in the transistor . 

To begin with, we use the Schottky equation to find the power 
spectrum of the noise current source: 

F 0 = 2el 0 , c = 2x 1.6 x 10~ 19 x 1.5 x 1(T 3 
= 4.8 x 1(T 22 A 2 Hz -1 

In setting up an equivalent output circuit for the amplifier, we 
note that here the system’s frequency response is the complex 
impedance placed in parallel with the current source: 

z »“ ) - 

where R eq = R^Ri/(Ri+ Ri). In our case, 

Req= 5.1 X 20/25.1 =4.06 kQ 

j 

The variance of the output noise voltage can be found b? 

Eq. (10.22) 

00 co 

- Fo 11 z (11= d/- F 0 Rlq J 

= F ° Keq = 1.16 x 10" 8 V 2 
4C b 

Finally, the rms value of the output noise voltage is 
<j v = |/o? = 108 pV 

Such calculations have to be performed whenever one s to 
determine the sensitivity limit of small-signal amplifiers. The usual 
procedure is to refer the rms noise voltage to the input bf the 


+ F sup 




Noise 

source 



t>. 
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equation 
cr i n = cr out/K 

where K is the gain of the system at the signal frequency. The value 
thus obtained is taken to be the least rms voltage of the useful 
harmonic signal that can be amplified by the device in question: 

T/min 1__ 

V m,s — [/ Tin 

In our example where the transconductance of the transistor is 
g m = 20mA/V, the gain at the zero frequency is 

K = g m R e q =81.2 
Therefore, 

c?in= 108/81.2= 1.33 pV 

and the minimum amplitude of the signal that can be amplified is 
k™ n = 1.33 x j/2 = 1.88 pV 

(It is assumed that the signal frequency is substantially lower than 
the upper frequency limit of the amplifier.) 

Summary 

00 If the mean value of a stationary random signal at the input of a linear system is zero, 
then the mean ?alue of the output signal will also be zero. 

OO The power spect*um of the output random signal is equal to that of the input signal 
multiplied by the square of the magnitude of the frequency response. 

OO An integrating RC- network excited by white noise has an exponential autocorrelation 
function. 

OO The output signal of a tuned amplifier driven by white noise is a narrowband random 
process. 

OO If a linear stationary circuit is sufficiently sluggish, then its output random process is 
asymptotically nornal, irrespective of the statistical properties of the input random 
process. 

OO In resistors, therma, noise arises owing to random fluctuations in the electric charge 
density. The thermal noise of a resistor has a practically constant power spectrum at 
all frequencies in the r.f. range. 

OO The power spectrum of thermal noise is found by the Nyquist law. 

OO The equivalent noise temperature of receiving antennas depends on the frequency 
band involved and nnges from several kelvins to millions of kelvins. 

OO The shot effect in elecron devices is related to the discrete nature of electron emission 
and statistical independence between the motions of individual charge carriers. 

OO The statistical properties of an electron stream are described by the Poisson 
distribution. 

OO In an equivalent circui, an electron device displaying the shot effect may be replaced 
with a noise current source having a uniform spectrum; the power spectrum of the 
current is defined by Schottky’s equation. 
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Review Questions 

1. How does the stationarity of the input random process figure in the derivation of the 
equation defining the power spectrum of the output random process? 

2. What is the approximate shape of plots for the autocorrelation functions of random 
signals: (a) at the output of an integrating /?C-network; (b) at the output of a single- 
stage tuned amplifier? The excitation is white noise in either case. Are the realizations 
differentiable in the statistical sense? 

3. What are the salient features of the autocorrelation function of the random signal at the 
output of a two-section RC-network excited by white noise? 

4. When may we replace the real process existing at the output of a real circuit with white 
noise? 

5. What is the noise bandwidth of a circuit? 

6. List the physical factors that cause the output signal of a linear circuit to be normalized. 

7. Describe the mechanism by which thermal noise arises in resistors. Define the frequency 
range within which thermal noise may be equated to white noise. 

8. What determines the noise voltage between the terminals of a receiving antenna? 

9. Describe the nature of shot noise in electron devices. 

10. Write the equation defining the Poisson distribution and interpret the physical signi¬ 
ficance of the parameter v. 

11. What is the equivalent circuit used to represent the noise properties of an electron 
device displaying the shot effect? 

12. How is the power spectrum of shot noise distributed in frequency? 


Problems 

3. There is an ided low-pass filter whose 
frequency response ii 

{ 0, C0< -00c 

K 0 , -co,<oo<co c 

0, co >ro c 

where co c is its cut-off frequency. It is 
driven by a voltage which is a stationary 
random process whose autocorrelation 
function is 

= CTxexp( - oc| T I) 

Find the power spectrum, the 
autocorrelation hnction and the variance of 
the output voltage. 

4. A series csonant circuit is driven by 
a white noise scurce whose power spectrum 
at all frequencies is W 0 . Determine the 
power spectruh and the autocorrelation 


1. A stationary random process X(t) 
whose power spectrum is 


W x (c») = 


0, co < 


- co. 


W 0 , -CO c <(D<(Or 


0, co > co c 

is applied to the input of an integrating 
RC-network. Find the variance of the out¬ 
put signal. 

2. Work Problem 1 for the same signal 
applied to the input of the differentiating 
network shown in the accompanying 
diagram: 
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function of the output voltage y(t). 



5. There is a single-stage tuned amplifier 
driven by a voltage source which generates 
Gaussian white noise with a power spectrum 
F 0 = 10 -15 V 2 Hz" 1 . The amplifier 
parameters are K res =100, Q e q=110, and 
/res = 15 MHz. Find the probability of the 
output noise voltage exceeding 2 mV. 

6. Derive the equation defining the 
power spectrum of the output signal from 
a two-section RC-filter (see Example 10.3) 
driven by a noise voltage whose 
autocorrelation function is 

KxW = cj|exp(-a|x|) 

7. The resonant circuit shown in the 
accompanying diagram 

—C=]—I 
R L 

4=C Li 


has the following paramefers: R = 8 fi, L= 
= 1.5 pH, and C = 120 pF. It is placed 
inside an enclosure with a temperature T = 
= 400 K. Find the variance of the noise 
voltage across the inductor and the noise 
bandwidth of the circuit. 

8. The amplitude response of a low-pass 
filter falls off linearly with rising frequency 
in the interval (0, / c ): Find the noise 



bandwidth of the system. 

9. Determine the noise bandwidth of the 


two-section RC-filter in Example 10.3. 

10. A resistor R = 10 kQ held at 
a temperature T = 300 K is connected to 
the input of an ideal low-pass filter having 
the following frequency response: 


\K\ 



}, Hz 


0 io 5 


Determine the variance and the 
autocorrelation function of the filter’s output 
signal. 

11. A microwave antenna with a radiation 
resistance of R^ = 2.5 Q picks up signals 
from a region in space at a temperature of 
T = 20 K. The bandwidth of the system is 
400 MHz. What is the rms noise voltage 
between the terminals of the antenna? 

12. Determine the variance of indications 
by a sluggish instrument measuring the 
current of a thermionic diode. The direct 
component of current is 0.3 mA, and the 
characteristic integration time (time 
constant) of the instrument is 2 s. 


Advanced Problems 

13. A random process X(t) whose 
autocorrelation function is K x (t 1 , t 2 ) is 
applied to the input of a linear stationary 
system for which the impulse response h(t) 
is known. Using the Duhamel superposition 
integral, show by direct calculation that the 
autocorrelation function of the output signal 
is defined by 

00 

Ky(h, t 2 )= jj KA^, % 2 ) 

— 00 

x^i-5i)k(h-y d^ 2 

that is, it is a two-dimensional convolution 
of K x (t 1 , t 2 ) with h(t). 
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14. Investigate the statistical charac¬ 
teristics of the random current in a system 
where electric-field forces cause a large 
number of minute conducting bodies (such 
as metal dust particles, small pieces of foil, 
and the like) to move between the plates of 
a capacitor. The number of particles moving 
at the same time is assumed sufficiently 
large for statistical analysis to be applicable. 
Determine the variance and power spectrum 
width of the process as functions of the 
system’s physical parameters. Think up 



r 
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a way of demonstrating the process. Propose 
its interpretation based on the shot noise 
model. Analyse the effect of the viscosity of 
the medium on the power spectrum width. 


Chapter 11 

Signal Transformations 
in Nonlinear Circuits 

So far we have dealt with linear circuits. A salient feature of any 
linear circuit is that it obeys the principle of superposition. 
A simple and very important conclusion can be derived from that 
principle: On passing through a linear stationary system, 
a harmonic signal remains unchanged in waveform, but acquires 
a different amplitude and a different initial phase. 

But it is precisely for this reason that a linear stationary system is 
not able to enrich the spectral composition of the waves applied to 
its input. This substantially limits the class of useful signal 
transformations that can be performed by constant-parameter linear 
circuits. 

A wider choice in this respect is offered by nonlmear systems 
characterized by the fact that in them the input signal Vm W and the 
response v out {t) are connected by a nonlinear functional relation of 
the form: 


l>out(r)=/(tfin, i) (1U) 


In this chapter we will examine some general features inherent in 
nonlinear systems, techniques of mathematical analysis, and the 
most important of signal transformations that are performed by 
nonlinear circuits and devices. 


11.1 Lag-Free (Zero-Memory) Nonlinear Transformations 

In the general case, an analysis of a nonlinear circuit is a very 
complex task because in deriving a mathematical description for the 
internal state of the system we inevitably run into the need to 
solve nonlinear differential equations. It is a well-known fact that 
they cannot be solved by the techniques that yield a relatively easy 
solution for linear differential equations with constant coefficients. 
Yet, there are cases where an analysis of a nonlinear system can be 
carried to completion with relatively simple techniques. For this it 
will suffice to require that the nonlinear relation of the form in 
(11.1) should not contain time explicitly. Physically, this requirement 
implies that the nonlinear element involved is free from time lag (or 
has zero memory ). In other words, its response instantaneously 
follows any changes in the excitation. 

Strictly speaking, zero-memory nonlinear elements are non¬ 
existent. However, this idealization is sufficiently accurate, if the 


The condition for a 
transformation to be a 
lag-free (zero-memo¬ 
ry) one 
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m 

The current-voltage 
characteristic 


characteristic time of change in the input signal is substantially 
greater than the transient response time of the nonlinear element 
itself. 

With regard to electronic circuits, nonlinear elements are most 
frequently semiconductor diodes and transistors. For their 
operation they depend on the diffusion of minority carriers in the 
regions of a semiconductor material directly adjacent to a P-N 
junction. Present-day semiconductor devices show a very high 
performance in terms of frequency properties. In them, the equilib¬ 
rium (steady) state can be reached in a matter of 10" 11 s. Therefore, 
the assumption that the internal processes in nonlinear circuit 
components are free from time lag is frequently well justified. 

External characteristics of lag-free (zero-memory) nonlinear 
elements. The functional relation in (11.1) may be looked upon as 
the simplest mathematical model of a nonlinear element. Its 
distinction is that is does not involve any of the internal processes 
occurring in the element. It is customary to say that here we have 
to do with the external characteristic of a system. 

To make matters more specific, the discussion that follows will be 
concerned with the external characteristics of nonlinear 
two-terminal networks (one-ports), assuming that the excitation is 
the voltage v across the one-port, and the response is the current 
i in that same one-port. The relation i(v) is usually called the 
current-voltage characteristic of a nonlinear element. All the techni¬ 
ques involved and the results thus obtained may be extended to 
include four-terminal networks, or two-ports, such as transistors 
operating in the nonlinear region at large amplitudes of the input 
signal. Here, the output circuit is represented as a current source 
controlled by the output voltage; the relation between the 
instantaneous values of voltage and current is substantially 
nonlinear. 

Practical nonlinear elements have a variety of external 
characteristics. For example, there is a class of nonlinear elements 
having univalued current-voltage characteristics (Fig. 11.1a), and 
a class of nonlinear elements whose characteristics include multiva¬ 
lued regions (Fig. 11.16). 

The resistance of a nonlinear one-port. With regard to 
a nonlinear one-port the concept of resistance may be defined in 
more than one way. Let i(v) be the current-voltage characteristic. 
On setting v= V 0 , the current in the circuit will be I 0 = i(V 0 ). The 
ratio 

R= = V 0 /I 0 (11.2) 

is called the d.c. resistance of the element. In contrast to the usual 
resistance of a linear resistor, R = is not constant, but varies with 
the applied voltage. 
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i, m A /, mA 




Fig. 11.1 Typical current-voltage characteristics of nonlinear two-port 
(four-terminal) networks: {a) single-valued characteristic of a crystal diode; 
(b) characteristic of a tunnel diode such that the same current can 
correspond to three different values of voltage 


Frequently, a nonlinear element is driven by two voltage sources 
at the same time, V 0 and Av 9 such that 

\Av\/\V 0 \«l 

On expanding the current-voltage characteristic into a Taylor series 
about point V 0 , we find the current to be 

ixl 0 + i'(V 0 ) Av 

The ratio of a change in voltage to the resultant change in 
current at the selected operating point (V 0 , 1 0 ) is called the dynamic 
or incremental resistance of a nonlinear one-port 

jRd = Av/Ai = 1 /i'(V 0 ) (11.3) 

Sometimes it is more convenient to use the dynamic 
transconduc tance 

9m = V#d - di/dv \ v = Vo (11.4) 



• 

Dynamic (incremen¬ 
tal) resistance and 
transconductance 


defined by the slope of the current-voltage characteristic at the 
specified operating point. 

It is to be stressed that the resort to the concept of dynamic 
resistance or dynamic transconductance is in effect the linearization 
of the actual current-voltage characteristic. It is valid solely for 
small increments in the signal about the operating point. 

Description of the characteristic of nonlinear elements. As a rule, 
the current-voltage characteristics of nonlinear elements are 
obtained experimentally; they can be found theoretically far more 
seldom. For an analytic study of the processes occurring in circuits 
containing such elements, it is necessary above all to present the 
current-voltage characteristics in a mathematical form suitable for 
calculations. 

The presentation of a characteristic in tabular lorm may be 
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It is assumed that base 
current is substan¬ 
tially smaller than 
collector current 


a simple and very accurate method. It is especially convenient for 
computer-aided circuit analysis; the argument and the function are 
stored in a computer’s memory as a two-dimensional array of 
numbers. Any specified accuracy can be obtained by making the 
step of tabulation sufficiently small, and also by using interpolation. 

Where a study is to be conducted by analytic rather than by 
numerical methods, the need arises to choose an approximating 
function which, while being sufficiently simple, could represent all 
the essential features of the characteristic obtained by experiment. 

The forms of approximation most frequently used in 
communication engineering in order to represent nonlinear 
characteristics are discussed in the pages that follow. 

Piecewise-linear approximation. This technique is based on 
replacing a real characteristic curve by straight-line segments 
varying in slope. It is usually employed to analyse processes in 
nonlinear elements in the case of large-amplitude excitations. As an 
example, Fig. 11.2 shows the input characteristic of a real transistor 
approximated with two straight-line segments. 

The approximation is determined by two parameters, namely the 
cut-off voltage V c and the transconductance g m which is the slope of 
the tangent to the curve at the specified points; its dimensions are 
units of conductance. Mathematically this is written as follows: 


f 0, v < V c 

\gm(v-V c ), v>V c 


(11.5) 


The cut-off voltage for the input characteristics of bipolar 
transistors is of the order of 0.2-0.8 V; the transconductance is 
usually around 10 mA/V. When instead of base current the 
dependent variable is collector current, with the base voltage being 
the independent variable, the value of transconductance must be 
multiplied by h 21 E, the base current transfer ratio (or gain). Since 
h 21 E = 100-200, the transconductance in this case is of the order of 
several amperes per volt. 



Fig. 11.2 Input characteristic of a transistor connected in 
a common-emitter circuit: base current is plotted as a function of 
base-emitter voltage 
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Power approximation. This form of approximation is based on 
expanding the nonlinear current-voltage characteristic i(v) into 
a Taylor series converging in the vicinity of the operating point V 0 : 

i(v) = a 0 + a 1 (v- V 0 ) + a 2 (v- V 0 ) 2 + ... (11.6) 

Here the coefficients a 0 , a u a 2 , ... are real numbers. The number of 
terms in the expansion depends on the desired or specified accuracy 
of calculations. 

Power approximation is widely used in the analysis of nonlinear 
devices driven by relatively small excitations. The manner in which 
the coefficients of the power expansion are found will be clear from 
the simple example that follows. 


The general formula: 


1 d n i 
n! dv n 


V = Vo 


Example 11.1. The experimental input characteristic i'b =/(vbe) of 
a transistor is specified by the plot of Fig. 11.3. Find the coefficients 
a 0 , a l9 and a 2 defining the approximation of the form 

i'b = a 0 + a l (i;be - V 0 ) + a 2 (vbe - V 0 ) 2 

in the vicinity of the operating point V 0 = 0.7 V. 

Let the nodes of the approximation be the points 0.5 V, 0.7 V, 
and 0.9 V. As is seen from the construction, in order to find the 
unknown coefficients, we should solve the following set of 
equations: 

a 0 — 0.2a 1 + 0.04a 2 = 0.05 
Solve Problem 1 a o = 0.15 

a 0 + 0.2^ + 0.04a 2 = 0.5 



Fig. 11.3 Power approximation of the input characteristic of a transistor 
connected in a common-emitter circuit 

Hence, 

a 0 = 0.15 mA, a x = 1.125 mA/V, a 2 = 3.125 ma/V 2 
It is to be stressed that power approximation gives 
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predominantly a local description of a characteristic. It is not 
advisable to use this technique when the instantaneous value of the 
input signal markedly deviates from the operating point, as the 
accuracy of calculation would then be too low. 

Exponential approximation. From the theory of P-N junctions, 
the following form is established for the current-voltage 
characteristic of a crystal diode for v>0 near the origin 

i(v) =i 0 [Qxp(v/v T ) — 1] (H. 7 ) 

Here i 0 is the leakage current across the junction, and vt is the 
thermal voltage which is set at 25 mV for silicon devices as 
measured at a standard temperature of 300 K. 

The exponential relation of the form (11.7) is frequently used in 
the study of nonlinear phenomena in electronic circuits containing 
semiconductor devices. The approximation is quite accurate for 
currents not exceeding several milliamperes. For heavier currents the 
exponential curve quietly changes into a straight line owing to the 
effect of the bulk resistance of the semiconductor material. 

11.2 The Spectral Composition of the Current 

in a Zero-Memory Nonlinear Element Driven 
by a Harmonic Excitation 


Consider what happens when a source of harmonic signal voltage 

Vs (t)= F m COSCO t 

and a source of d.c. bias voltage V 0 drive a zero-memory (lag-free) 
nonlmear element. The waveform of the current in the circuit can 
be found by taking advantage of the simple graphic construction in 
Fig. 11.4. 



Fig. 11.4 Construction of a curve representing variations in the current in 
a lag-free nonlinear circuit 
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It is easy to see that the current and the voltage differ in 
waveform. The cause of distortion in the current waveform is very 
simple: Equal changes in the voltage bring about unequal changes in 
the current because 

Ai = gd(v)Av 

Also, the dynamic transconductance is likewise different within 
different portions of the curve. 

The basic principle. If we approach the problem analytically, we 
will note that the function 


i(t) = i(V 0 + V m cos cot) 

defining the instantaneous values of current is a periodic one with 
period T= 27c/co. Therefore, it can always be expanded in a Fourier 
series 

00 

j(t) = / 0 + Yj 7nCOS(nCOt + cp n ) (11.8) 

n= 1 


Physically, this implies that the current in a lag-free nonlinear 
element is the sum of the d.c. component and, generally, an infinite 
set of harmonics at frequencies co, 2co, 3 cd, .... 

In engineering calculations, the most important task is to find the 
amplitudes of the spectral components of current (7 0 , I l9 I 2 , ...) as 
functions of the bias voltage and of the amplitude of the driving 
voltage V m . Solution is carried out differently, according to the 
form of the approximating function used. 

Piecewise-linear approximation. The waveform of current in 
a circuit containing a nonlinear element such that 


The spectral composi¬ 
tion of current in a 
lag-free (zero-memo¬ 
ry) one-port 


(g m (v-v c ), v>V c 
1 o, V < V c 

where V c is the cut-off (or cut-in) voltage, and driven by v = V 0 + 
-I- F m cos cot, is seen from the construction in Fig. 11.5. 

The current waveform is a succession of cosine pulses with cut¬ 
off. The spectral composition of such a periodic process was 
examined in detail in Chap. 2. 

The cut-off angle* of current pulses can be found from the 
equation 

V 0 + V m cos 0 = V c 


* The cut-off angle is half the angle of current flow or operating angle. 
- Translators ’s note. 
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Fig. 11.5 The current in a circuit containing a piecewise-linear element 


Hence, 


cos 0 = - 


Vc-Vp 

V m 


( 11 . 10 ) 


The direct component and the amplitudes of current harmonics are 
found by the equations 

| ^o = ^^nYo(^) (1111) 

( In = Qm fmYn(O) 

which include the corresponding Berg functions y „(0). 


Example 11.2. A nonlinear element has a piecewise-linear current- 
voltage characteristics with the following parameters: V c = 0 .6 V and 
g m = 25 mA/V. The voltage applied to the element is u = 0.2 + 
+ 0.8 cos cot (V). Find the d.c . component I 0 and the fundamental 
of the current. 

Since 


cos 0 = 


0.6 - 0.2 

08 


= 0.5 


then 
0 = 60° 

The values of the Berg functions are as follows: 


y 0 = — (sin 0 — 0 cos 0) = 0.109 
n 

= —(0 — sin 0 cos 0) = 0.196 
n 
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Using Eqs. (11.11), we obtain: 
I 0 = 25 x 0.8 x 0.109 = 2.18 mA 

I, = 25 x 0.8 x 0.196 = 3.92 mA 


Power approximation. Let 

i = a 0 + a 1 (v- V 0 ) + a 2 (v- V 0 ) 2 + ... (11.12) 

and the voltage applied to a nonlinear one-port be 
v (t) = V 0 + V m cos cat 

Taking advantage of the well-known formulae 
cos 2 x = V 2 (1 + cos 2x) 

cos 3 x = V 4 (3 cos x + cos 3x) 

cos 4 x = V 8 (3 + 4 cos 2x + cos 4x) 

cos 5 x = Vi6 (10 cos x + 5 cos 3x + cos 5x) 


we can re-write Eq. (11.12) as 
i = ( a 0 + V2 a 2 V 2 m + 3 / 8 a^.V^ m + ...) 

{aiV m -\- / 4 a 3 V m + /s a$Vf n -\- ...)cos cot 
F (V 2 a 2 FmF Vs Vm + • • •) cos 2 cot 

+ (V 4 fl 3 ^m+ 5 / 16 a 5 V 5 m+ ...)cos3cot + ... (11.13) 

Hence, the following relations can be written for the direct 
component of current and the amplitudes of harmonics: 

10 = A /2 a 2 V'rn “h Vs a 4. Vm + n . .. 

h = «ikm + 3 / 4 a 3 V 3 m + 5 /s a 5 v 5 m + ... 

^2 = V 2 a 2 ^m + Vs a 4Vm + ••• (11.14) 

h = V 4 a 3 V 3 m + 5 / 16 a 5 V 5 m + ... 


It is to be noted that the d. c. component and the amplitudes of 
even harmonics are determined by the even-numbered coefficients 
of the Taylor series, and the odd harmonics depend solely on the 
odd-numbered coefficients. 

Exponential approximation. If the current-voltage characteristic 


11-728 
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of a nonlinear one-port can be approximated with an expression 
of the form 

i(v) = f'o [exp (av)- 1] 

the current spectrum can be found on the basis of the equation 

00 

exp (x cos cot) = / 0 (x) + 2 £ 7„(x)cosncot (H-15) 

n= 1 

where I n (x) is a modified Bessel function of index n. 

If a nonlinear one-port with an exponential current-voltage 
characteristic is excited by the sum of the bias voltage and the 
harmonic signal voltage, that is 

v=V 0 +V m cos co t 

then 


i(t) = i 0 [exp (aV 0 )I 0 (aV m ) - 1] 


00 

+ 2 i 0 exp ( aV 0 ) £ In(aVm) cos ncot 

n = 1 


(11.16) 



Nonlinear distortion in a resistively loaded amplifier. The 
transformation that the spectrum of the input signal undergoes in 
nonlinear circuits is an extremely important matter. On the one 
hand, this spectrum transformation forms the basis for the 
operation of modulators, detectors and a number of other similar 
devices, which will be discussed below. On the other, the nonlinear 
behaviour gives rise to undesirable effects which must be properly 
evaluated and taken into consideration. 

As an example of nonlinearity effects, we will examine 
a single-stage transistor amplifier loaded into a resistor, Rl- In 
contrast to a small-signal amplifier (see Chap. 8), it will be assumed 
that the amplitude of the input harmonic signal V m> i n is sufficiently 
large to make it essential to consider the nonlinearity of the transfer 
characteristic i c =/(i; BE ) of the transistor connected in 
a common-emitter circuit. In the simplest case and with a properly 
positioned operating point, let this characteristic be specified by 
a second-order polynomial: 

ic =a 0 + a 1 (i?be - V 0 ) + “2 (^be - V 0 ) 2 

If the amplifier is driven by the voltage 

fBE= Vq T - fm,in COS CO t 

the current in the collector lead will contain a steady (d. c.) 
component and also the fundamental and the second harmonic of 
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The nonlinear distor¬ 
tion factor 


11.3 Nonlinear Tuned Amplifiers 
and Frequency Multipliers 

The key element of almost any radio transmitter is an r. f. tuned 
power amplifier. Its distinction is the fact that it operates at very 
large amplitudes of the input voltage. Therefore it is mandatory to 
take into account the nonlinearity of the current-voltage 
characteristic of the active element involved, which may be 
a transistor (transistors) or a tube (tubes). 

Operating principle of a nonlinear tuned amplifier. Consider 
a single-stage transistor amplifier (Fig. 11.6a) loaded into a parallel 
resonant circuit (usually called the tank). The amplifier is driven by 
a voltage n (t) =V Q + F m? i n coscot, and the resonant circuit is tuned 
to the signal frequency: co res = a>. 

Suppose that the transistor characteristic j'c=/(^be) is 
approximated with straight-line segments and refer to Fig. 11.66. 
The collector current waveform consists of a series of cosine pulses 
with cutoff (class C waveform). The pulses have a complex spectral 
composition, but the leading role in the operation of the amplifier 
is only played by the fundamental component whose frequency is 
the same as the resonant frequency of the tuned (or tank) circuit. 
The impedance of the tank circuit at harmonic frequencies 2co, 3a>, 
... is so low that the higher harmonics do not practically contribute 
to the output signal. 

The fundamental of the collector current produces at the output 
a useful signal whose amplitude is 

!m,out = I iRres = 0mRres Fm,in Yi (ff) (11.19) 














h — a iV m ,m, 12 ~ 1 12 a 2Vlrn,m 

These harmonic currents produce across the load resistor a voltage 
drop which is included in the output signal of the amplifier and 
distort it. Quantitatively, the degree of distortion in the output 
signal of an amplifier is stated in terms of the nonlinear distortion 
factor k n \ defined as the ratio of the rms value of all the higher 
harmonics (except the fundamental) to the amplitude of the useful 
signal : 


k n \ = 


vn+n+n+- 

h 


(11.17) 


In our case, 

^nl = 1 2 / 1 1 = / 2 («2/«i) V m,in 

Importantly, the nonlinear distortion factor increases with 
increasing amplitude of the signal. 


(11.18) 


11* 
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Fig. 11.6 Nonlinear tuned amplifier: (a) schematic diagram; ( b ) time 
waveforms of currents and voltages 


The internal resistance 
of the source is ab¬ 
sorbed in the resonant 
resistance 


▲ 

Solve Problem 2 


In a similar way, using Eq. (11.14) we may write an expression 
for the amplitude of the harmonic signal at the output of the tuned 
amplifier when power approximation is used for the transistor 
characteristic: 

l / m,out=«res(fli^m,in+ 3 /4fl3^m,in+ 5 /8«5^m,in+ •••) l 11 - 20 ) 

The dynamic transfer characteristic of an amplifier. This refers to 
the relation F m , 0 ut =f(V m ; m ) stemming from Eq. (11.19) or (11.20). 
Naturally, it is required that the dynamic transfer characteristic be 
linear, especially in the case of amplifiers for AM signals. As follows 
from, say, Eq. (11.19), the dynamic transfer characteristic is in the 
general case nonlinear, because the cut-off angle 9 and, as 
a consequence, the Berg function y x (9) depend on the amplitude of 
the driving voltage V m ^ n . The only exception is when the operating 
point is located at the origin. As can readily be seen, the cut-off 
angle is then 9 = 90°, irrespective of the value of V m j n - 

A further advantage of operation at a cut-off angle of 90° is that 
in the “no-signal” condition the d. c. component of collector current 
is zero. This factor has a wholesome effect on the efficiency of the 
amplifier. 

An important parameter of the dynamic transfer characteristic is 
the width of its linear portion, as it determines the dynamic range 
of the signals being amplified. A natural factor limiting the rate of 
rise of the dynamic transfer characteristic is this: At some critical 
value of the input-signal amplitude, Em,in, the tuned-circuit voltage 
becomes comparable in magnitude with the supply voltage E S up- 
Any further increase in the tuned-circuit voltage becomes 
impossible because at some instants of time the collector voltage of 
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the transistor crosses zero. In consequence, the normally turned-off 
collector junction is rendered conducting, and the tuned circuit of 
the amplifier is heavily shunted by the circuit containing the 
collector, base, signal source and power supply. 

If I'm,in > Vm, in, the amplifier is said to be overdriven. This 
condition cannot be used to amplify AM signals. However, by 
bringing down the supply voltage, a tuned amplifier can be brought 
to the overdriven condition, thereby turning it into an amplitude 
limiter, a device which suppresses the parasitic modulation of FM 
or PM signals. 

Power relations in a nonlinear tuned amplifier. Amplifiers of the 
type considered here handle a fairly large amount of power, so high 
efficiency is an important requirement for them. In order to 
determine the efficiency of an amplifier, we need to know the power 
drawn from the power supply 

P sup = lo-^sup 

and the useful active power in the tuned circuit 

Tuseful = 1 /2-I i En,out 

In power amplifiers, it is sought to utilize the power supply to 
the utmost, even by coming very nearly to the overdriven operating 
condition, such that E m , 0 ut ~ £ S up- Then 

efficiency = P U seful/Psup = V 2 Y 1 (9)/y 0 (9) (11.21) 

If we analyse the ratio Yi (9)/Yo(H)> we will readily see that it is 
a maximum and equal to two for 9 = 0°. As 9 is increased, the ratio 
falls off, being n/2 = 1.571 Tfor 90°. Therefore, from the view-point of 
power utilization, it would seem advantageous to operate the 
amplifier at small values of 9, when the efficiency of the amplifier 
approaches unity. This would happen because the electron device 
would be turned off for the greater part of the cycle, and no power 
would be dissipated as heat at the collector (anode). This would, 
however, entail a drastic reduction in the value of y x , and in order 
to obtain the desired power output, we would have to substantially 
raise the amplitude of the input signal, which is not always possible. 
Therefore, bearing in mind the linearity of the transfer 
characteristic, the usual practice is to sacrifice some of the efficiency 
and to set the cut-off angle close to 90° (an operating angle of 
about 180°). 

Resonance frequency multiplication. If we tune the tank circuit of 
a tuned amplifier operating at high amplitudes of the input signal 
to wo, which is the frequency of one of the signal’s higher 
harmonics, the device can be used as a frequency multiplier. 

A frequency multiplier comes in useful when one needs a highly 
stable source of harmonic waves which cannot, for one reason or 



0 V CT ■ V ■ 

m, in m, in 


(1) Underdriven condi¬ 
tion ; (2) overdriven 
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another, be generated directly, while a sufficiently stable low-fre¬ 
quency oscillator is available. 

Often frequency multipliers are used in FM or PM transmitters 
in order to increase the frequency deviation of the signal. If at the 
input to a multiplier the frequency deviation is Aco, then at the 
multiplier’s output it will obviously be nAoo, where n is the 
multiplier factor. 

In principle, the design of a frequency multiplier does not differ 
from that of a nonlinear tuned amplifier. By analogy with 
Eq. (11.19), the amplitude of the output signal from a frequency 
multiplier in the case of piecewise-linear approximation is defined 
by 

Vm,out = g m R res Vm, inYn(S) (11.22) 


Output pulses for small 
values of the cut-off 
angle 


One of the difficulties arising in the synthesis of tuned frequency 
multipliers is that the function y„(9) has a very low value at high 
values of the multiplier factor. Therefore, the cut-off angle must be 
chosen so as to maximize the corresponding Berg function. The 
smaller the ratio of the period to the duration of the collector 
current pulses*, the richer is their spectral composition. Hence, if 
the objective is to build a frequency multiplier with a high 
multiplier factor, the cut-off angle must be chosen very small. From 
analysis of the function y„(9) it is seen that there exists an optimal 
cut-off angle, 9 op t, defined as 

9opt=180°/n 01-23) 


This is the value of cut-off angle for a frequency multiplier 
operating at a fixed amplitude of the driving voltage V m ; m . 


11.4 Lag-Free (Zero-Memory) Nonlinear Transformations 
of a Sum of Harmonic Signals 

The property of a nonlinear network to enrich the spectrum of 
the output signal by adding to it the spectral components 
nonexisting in the input wave is most pronounced when the input 
signal is a sum of several harmonic waves differing in frequency. 
The appearance of a large number of new spectral components is 
the basis of the important nonlinear signal transformations that will 
be discussed in the next section. 

The response of a nonlinear element having a po¬ 
wer-approximation characteristic to a biharmonic excitation. We set 
out to elucidate the response of a nonlinear one-port whose 
current-voltage characteristic is described by, say, a second-order 


* This is the reciprocal of the pulse duty factor, t/T- Translator’s note. 
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polynomial: 

i(v) = a 0 + a l (v- V 0 ) + a 2 (v- V 0 ) 2 (11.24) 

In addition to the constant term V 0 , the applied voltage contains 
two harmonic waves at different frequencies co x and co 2 . Their 
amplitudes are V mi and V m2 respectively: 

v = V 0 + V mi costOjt-l- V m2 cosm 2 t (11.25) 


This is known as the biharmonic excitation. It is especially 
convenient in analysing spectrum transformations in nonlinear 
circuits. 

On substituting the signal defined by (11.25) in Eq. (11.24), we 
obtain 

i(t) = a 0 + a i V mi cos a> 1 t + a 2 V m2 cos © 2 r 

+ tt 2 Vmi cos 2 cojt + 2a 2 V mi V m2 costofcosa^ 

+ a 2 Vm 2 cos 2 co 2 f 

After simple rearrangement we obtain the following spectral 
representation of the current in a nonlinear one-port: 


/(f) = 


+ + V m 2 ) +a 1 V mi COSCG^ 

t r ^ 2 ^ 

+ a l Vm2 cos H-Z-COS 2C0J t 


a?V 2 


t*2 y YY12 

d-2- cos 2(0 2 t +^3 2 k/ni Vm2 COS (C0j +C0 2 )t 


+ a 2 V mi Vm 2 cos (©! -co 2 )t 


(11.26) 


As is seen, the current waveform contains the d. c. components, 
the fundamentals, and the second harmonics of the two input 
signals-they all were present prior to the transformation. In 
addition, it contains two new harmonic components at the sum and 
difference frequencies co x + oo 2 and a, - co 2 . Importantly, the 
amplitudes of these two waves, equal to a 2 V mi V m2 , depend on the 
amplitudes of the two input signals to the same extent, and vanish 
when one of the two signals is not applied to the input. This is an 
indication that the nonlinearity of the one-port is responsible for the 
interaction of the various harmonic components of the aggregate input 
signal. A complete spectral diagram of the current in the one-port 
under consideration for the form of excitation chosen is shown in 
Fig. 11.7. 

The effect of the cubic term of the current-voltage characteristic. 


_ U) 
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The frequency spec¬ 
trum of a biharmo¬ 
nic signal 


▲ 

Solve Problem 3 
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Fig. 11.7 Spectral diagram of the current in a nonlinear one-port whose 
current-voltage characteristic is described by a quadratic polynomial. (The 
input signal is a biharmonic wave whose spectrum is shown as a coloured 
block in the figure) 

Let us make our problem somewhat more elaborate by assuming 
that the current-voltage characteristic i(v) contains a cubic term 
responsible for an additional current defined by 

; 3 = a 3 (t>-Fo ) 3 (1L27) 

On inserting the signal defined by Eq. (11.25), we get 
h (t) = a 3 1 + 3 /2 hwii ^m 2 ) cos 

+ ( 3 /4^m2 "b 3 /2^mi Vmf) COS C0 2 t 

+ cos 3cM + ™— cos 3co 2 t 

+ 3 /4 Vmi En2 COS (^©1 “b ^ 2 ) ^ 

+ 3 /4Lmi bm2 COS (2®i C0 2 ) t 

+ ^I^Ym\Vm 2 cos “b ®l) ^ 

+ 3 / 4 Kni E* 2 cos (2 cd 2 co,) t] 0 1 * 28 ) 

As is seen, the cubic term somewhat affects the amplitudes of the 
fundamental terms of current at frequencies % and co 2 . More 
importantly, however, there appear new spectral components at fre¬ 
quencies 3co 1? 3 co 2 , 2cd 1 +co 2 , 2(0! - co 2 , 2® 2 + (o 1 , an d 2(0 2 — ®i- 
Intermodulation frequencies. The example we have just analysed 
is a very special case because, firstly, the applied voltage has only 
two spectral components and, secondly, the current-voltage 
characteristic containing a quadratic or a cubic nonlinearity is very 
simple in form. The general statement of the problem is this: The 
current-voltage characteristic i(v) is arbitrary; the input signal is 
represented by a trigonometric sum: 

00 

v(t) = V 0 + X V m ,kCOS(Okt 

k= 1 


(11.29) 
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It is required to find the amplitudes and frequencies of all the 
spectral components present in the current. 

This problem can be solved in a variety of ways, depending on 
the form of approximation used for the current-voltage 
characteristic [37]. The task of finding the amplitudes of the 
harmonic components usually involves cumbersome calculations, 
and we will not undertake to tackle it. In analysing the frequencies 
of the spectral components in the output signal, we can note, as has 
been confirmed by the previous example, that these so-called 
intermodulation (or combination) frequencies are specified by 
a general expression of the form 


co= | n 1 cd 1 +n 2 co 2 + ... +n m <o w + ...| (11.30) 


where the nfs are any whole numbers, positive and negative, 
including zero. 

It is usual to group intermodulation frequencies by collecting the 
frequencies for which 

K | + I n 2 | + ... + \n m \ + ... = N (11.31) 

The number N is called the order or degree of an intermodulation 
frequency. 

As the above example demonstrates, when a system is driven by 
a sum of two harmonic signals, the spectrum of the current flowing 
through the nonlinear element whose current-voltage characteristic 
contains terms of at most the third power includes intermodulation 
frequencies which can be grouped as follows: 


N Frequencies « 

1 co 1? oo 2 

2 2®!, 2co 2 , cOj + co 2 , cOj — co 2 

3 3©!, 3co 2 > 2© x + © 2 , 2©! — © 2 , 2© 2 + ©j, 2© 2 — © x 

It is important to note that the term of power N in the current- 
voltage characteristic is responsible for the appearance of 
intermodulation components whose highest order is equal to the 
power of that term. Also, if N is an even number, the associated 
intermodulation frequencies are likewise even: N, N — 2, N — 4, up 
to N = 0 (the d. c. component). If, on the other hand, N is odd, the 
intermodulation frequencies are odd, too: N, N - 2, N — 4 up to 
N= 1. 


Example 11.3. A nonlinear element has 
characteristic 


m 

Intermodulation fre¬ 
quencies 


▲ 

Work Problem 3 


cubic current-voltage 


i(v) = a 3 (v- F 0 ) 3 
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The input voltage contains three harmonic waves: 

V = V 0 + Vmi COS (tij + V mi cos ( 0 2 t + V m3 COS CO 3 t 

Find the frequencies of all the intermodulation components of the 
current. 

Since the power of the characteristic is three, there will be 
intermodulation frequencies with N = 1 and N = 3. The first-order 
intermodulation frequencies are co 1? co 2 , and g> 3 . 

The third-order intermodulation frequencies are: 

3co l5 3 co 2 , 3co 3 , | + ccq + co 2 + co 3 1 

| ± 2 ( d 1 ± co 2 |, | ± 2 c 0 i ± co 3 1, | ± 2 co 2 ± aq | 

| ± 2co 2 ± co 3 1, | + 2 co 3 ± ccq1, | ± 2 co 3 ± co 2 | 


Actually, only distinct frequencies need to be taken into 
consideration. The terms 2co 1 + co 2 and — 2(n l — co 2 have the same 
frequency. 



The filtering of intermodulation frequencies. The use of nonlinear 
devices for signal transformation is based on the following 
principle. When a lag-free (zero-memory) nonlinear element is 
driven by a sum of original waves, the output signal contains all 
likely combinations of intermodulation components. If now the out¬ 
put signal is passed through a linear frequency-selective network (a 
filter), a whole range of useful effects can be achieved because the 
output signal will contain spectral components previously 
nonexistent at the input. 

One of the devices operating by this principle is the nonlinear 
tuned frequency multiplier that has already been examined. The 
spectrum transformation performed by a frequency multiplier is 
very simple because there is only one harmonic input signal. 


11.5 Amplitude Modulation. 

Detection of AM Signals 

The term “amplitude modulator” refers to a device which produces 
across its output terminals an AM signal of the form 

vam (t) = v m (1 + M COS Fit) COS 0 0 0 t 

when its input accepts the harmonic carrier wave 

t^can (0 = I'm, car COS CO 0 t 

and the baseband modulating signal 

^mod (0 = I'm,mod OOS Fit 

Most often, amplitude modulators are built to utilize the transforma- 
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Fig. 11.8 Currents and voltages in an amplitude modulator 


tion that the sum of the two applied signals undergoes in a lag-free 
(zero-memory) nonlinear element. 

The principle of operation of an amplitude modulator. The 
simplest amplitude modulator is a single-stage nonlinear device 
loaded into a resonant (tuned) circuit. The input to the stage is 
a voltage of the form 

Vm (0 = ko + I'm,mod COS Fit + Im,car COS CO 0 t (11.32) 

The resonant circuit in the collector lead is tuned to the carrier 
frequency. The operation of this amplitude modulator is explained 
for the current and voltage waveforms appearing in Fig. 11.8. 

For definiteness, it is assumed that the current-voltage 
characteristic of the transistor is approximated with two straight- 
line segments. Since the Q-point moves in step with the baseband 
modulating wave, the cut-off angle of the carrier is continuously 
changing. Because of this the fundamental of the collector current 
pulse sequence is varying in time. The tuned circuit filters the 
collector current so that its output delivers an AM signal, that is, 
a wave whose amplitude varies in proportion to the modulating 
signal. 

Example 11.4. The current-voltage characteristic of the transistor 
used in a modulator circuit has a kink at V c = 0.6 V. The amplitude of 
the carrier at the input is V m , car =0A V. The amplitude of the 
modulating signal is F m?mo d = 0.1 V. The quiescent bias voltage is 
V 0 = 0.6 Y. Find the modulation factor M for the circuit in question. 

According to the statement of the problem, the Q-point moves 
between the limits V 0 + F m , mod = 0.7 V and V 0 - F m , mod = 0.5 V. 
Hence, the cut-off angle varies between 

q 0.6-0.7 

0 max = arc cos 


T is S up 



0.4 


= 1.823 rad 



















































































332 


Part Two. Circuits 


and 

n 0.6 - 0.5 

O m in = arccos-—-=1.318 rad 

0.4 


The amplitude of the collector-current fundamental is 
proportional to the Berg function y x (0) which varies between the 
limits 

Yi(0max) == ^(Omax sin $max cos $max) = 0.657 
n 

and 


Solve Problem 4 


Yi(^min) — (^min sin 0 m j n COS 0 m i n ) 0.342 

TC 

Hence, the modulation depth is 


M = 


^i,max ^i, 


0.657 - 0.342 


fi,max+ /i,min 0.657 + 0.342 


= 0.315 


The spectrum of a 


Analytical consideration. The production of an AM signal can be 
investigated analytically by using the above theory of 


a modulator 


wave at the input ol intermodulation frequencies. Suppose that a nonlinear element 
having the simplest current-voltage characteristic of the form (11.24) 
is driven by the voltage 

v(t) =v 0 + Tm,car COS C0 0 t + F m , mo dCOS Q.t 

such that co 0 »£l 

The current flowing through the one-port contains components 
whose frequencies are close to co 0 . These components make up the 
amplitude-modulated current 

JAmM = fm,carCOS CO 0 t + d 2 V m , car km, mod COS (C0 0 + Q) t 


0 Q Wo 

and at its output 


4 - a 2 km,car km, mod COS (C 0 0 D) t 


(11.33) 


u) 0 —Q u)q + ^ 


As will be recalled (see Chap. 4), the relative level of the side 
lobes in comparison with the carrier is M/2. From Eq. (11.33) it 
follows that in our case the modulation factor is 


(11.34) 


2a 2 

M = V m ,m od 

Detection of AM signals. Detection (also called demodulation) 
refers to the process of separating the modulating signal from 
a modulated carrier. If the input signal to an ideal detector is an 
AM wave 

V[ n (t)= Vm, in(l + M COS Qt) COS C0 0 t 


r 
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the wave appearing at its output will be a low-frequency signal 

^out(t) = k/7i 5 out COS Dt 

proportional to the message signal being transmitted. 

It is usual to define the performance of a detector in terms of the 
detection (or demodulation) ratio 

kdet == Vm,out/MV m jn (11.35) 

Detection is a strictly nonlinear operation because the spectrum 
of the input wave does not contain the component at frequency Q. 
Detection can be performed by applying the AM signal to a lag-free 
(zero-memory) nonlinear element and by filtering the resultant low- 
frequency components of the spectrum. 

Consider the operation of what is called the collector detector 
which is a single-stage transistor circuit loaded into a parallel 
RC-network. For the load network to operate as a frequency filter 
suppressing all high-frequency spectral components, it is required 
that 


1/g) 0 C l «Rl, 1/DC l »Rl (11.36) 


This signifies that for the signal at the modulating frequency Q the 
detector load is practically resistive and equal to R L , whereas the 
magnitude of the load impedance and, in consequence the fre¬ 
quency response of the system at the carrier frequency co 0 are neg¬ 
ligibly small. Let 

Vin(t) = V 0 + F m> in(l + M QOS Qt) cos co 0 t 

with F m? in being sufficiently large for piecewise-linear approximation 
to be applicable to the current-voltage characteristic of the 
nonlinear element. Also, to simplify matters, let V 0 = V c (which 
means that the system is biased at cut-off). Then the angle of cut-off 
will be 0 = 90°, irrespective of variations in the amplitude of the 
input signal in time. The operation of the collector detector is 
illustrated in the plots of Fig. 11.9. 

Referring to Fig. 11.9, the collector current pulse sequence is 
amplitude-modulated; the zero current component is slowly varying 
(at frequency Q), such that 

j 0 ,C = 9m km,in(1 + M cos Qt) y 0 (90°) = 0.318^f m F m?in (l + M cos at) 
The output voltage of the detector is 

^out(0 = £ SU p — 7 o,c^l 

— £ SU p — 0.318g m RL Fm,in(l + M cos Qt) 


The detection (de¬ 
modulation) ratio 


T Ejup 

- 0 



k 0 

The collector detector 


(11.37) 
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Fig. 11.9 Waveforms of currents and voltages in a collector detector 

Hence, the detection ratio of the detector is 
/c d et=O.318 0m i?L (U.38) 

Importantly, the amplitudes of the input and output signals are 
in direct proportion. Quite aptly, this detector is said to effect linear 
• detection. Its salient feature is freedom from distortion in the 

Linear detection transmitted message. 

Square-law detection. Let us consider separately a case of 
importance to applications, involving the detection of weak signals 
when the current-voltage characteristic of the nonlinear element has 
to be approximated with a power relation of the form 

ic( v ) = a 0 4- a 1 (v m — V 0 ) 4- a 2 ( v m — V 0 ) 2 4*... (11.39) 

We will limit ourselves to the terms written out and assume that 
the detector accepts an AM signal along with a d. c. bias voltage 
V 0 : 

Vm{t) = V 0 4- F m ,in(l + M COS Qt) COS CO 0 t (11.40) 

On substituting (11.40) into (11.39), we find that among the 
various intermodulation waves present in the current, there is the 
following low-frequency component: 

i If (t) = a 2 V^ in M cos Qt + fl2 ^ m ’ in M 2 cos2Qt (11.41) 

Owing to the filtering action of the load .RC-network, the output 
signal will be determined by exactly this current: 

rout (t) = £sup - a 2 R L V 2 mM M cosQf - ^^-cos 2 Qt (11.42) 

Here the output voltage is proportional to the square of V m ; m , for 
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which reason this form of operation is called square-law detection. 

The presence of the term proportional to cos2Qt in (11.42) is an 
indication that square-law detection is accompanied by distortion 
of the received message. On introducing the nonlinear distortion 
factor fc n i, equal to the ratio of the amplitudes of output waves at 
frequencies 2Q and Q, we find from Eq. (11.42) that k nl = M/4. 

Hence it is clear that nonlinear distortion will be especially heavy ■ 

at a high degree of modulation of the input signal. Therefore, in Nonlinear distortion 

receivers it is desirable that the amplitude of the carrier in the AM due to detection 

signal applied to the detector’s input be limited to a few volts. Then 

the detector will operate in the linear mode and there will be no 

nonlinear distortion in the received message. 

Interaction of the valid signal and noise in a detector. Suppose 
that in addition to the valid AM signal the input of a square-law 
detector accepts an unmodulated noise wave whose frequency co n is 
close to the carrier frequency co 0 , such that 

Vin(t) = V 0 + V m j n (l 4* M COS Qt) COS C0 0 t + F^nCOS C0 n t 

The current due to the quadratic term in (11.39) is then equal to 
h (0 = a 2 ( v in— v 0 ) 2 = a 2 V 2 m ; m {f + M cos Qt) 2 cos 2 co 0 t 

+ 2a 2 Vmjm Fm,n(l + M cos Qt)cos co 0 tcos co n t 4- a 2 V^ in cos 2 co n t 

(11.43) 

On the basis of Eq. (11.43), the additional low-frequency current 
component, which owes its origin to the noise wave, is equal to 

Ailf(t) = /2 Q 2 V m j n Fm,nAf [COS (co 0 — C0 n + Q) t 

4~ COS (C0 0 f J 4“ tl 2 V m j n I4n,n COS (C0 0 — ®n) t 

Thus, even with no modulation (M = 0), there is, at the detector’s 
output, a low-frequency harmonic signal at frequency co 0 - co n . 

When M^O, the spectrum of the output signal becomes even more 
complex owing to the appearance of the low-frequency 
intermodulation waves at frequencies co 0 - co n + Q and co 0 - co n - 
- Q. These frequencies are close to those of the useful signal and 
cannot in principle be removed by filtering. If V m , n »V mM , noise 
may substantially exceed the valid signal. In this sense, one speaks 
of the suppression of a weak useful signal by a strong noise. In order 
to minimize signal suppression, every effort should be made to 
reduce as much as possible the noise level during detection. 

The diode AM detector*. This is a widely used type of detector, 


It is otherwise referred to as a linear or an envelope 
detector-Translator's note. 
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especially effective in large-signal operation. It consists of a series 
combination of a crystal diode and a parallel RC- network which 
acts as a frequency filter. The element values of the RC-network are 
chosen according to the condition defined in (11.36). 

Assume that the diode has a piecewise-linear current-voltage 
characteristic and biased exactly at the cut-off voltage: 



For the circuit to operate normally, it is essential that the load 
resistance Rl be substantially greater than the diode resistance in 
the forward direction, that is, 


Pout 



dmR 1 

Let us apply to the detector input an unmodulated harmonic 
signal 

V'm{t) = F m? inCOSC0 0 l 

The capacitor charges via the forward resistance of the conducting 
diode much faster than it discharges via the high-value load 
resistor, and so the output signal is a sawtooth waveform with low 
teeth. The average level of the output voltage is close to the 
amplitude of the input signal. Thus, the diode remains 
nonconducting for a greater proportion of the cycle. 

Let us neglect the minute variations in the output signal and take 
it that Lout is constant. We also note that F ou t is applied to the 
diode in reverse polarity and acts as its bias voltage 


Vo — ~ Lout 


The detection factor of the circuit 



kdet — F 0 ut/F m? in — C °S O' 

may be close to unit, because the cut-off angle is sufficiently small. 
The cut-off angle is found from the relation 

~ V 0 — lo^L = Qm km,in Yo (0) Rl 

whence a transcendental equation follows 

cos 0 = ———(sin 0 — 0 cos 0) 
n 

or 


The output voltage of tan 0 - 0 = n/g m R L (11.44) 

a diode detector is _ 

close in amplitude to 

the input signal For g m RL»U the cut-off angle is zero very nearly, so that the 
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following relation can be derived from Eq. (11.44) for the detection 
factor: 


kdet = cos(37r/g m jRL) 1/3 


(11.45) 


▲ 

Work Problem 5 


Example 11.5. In a diode detector, R L =18 kfl, and the diode 
transconductance is g m =10mA/V. Find the detection factor. 

The product of the transconductance by the load resistance gives 

0m*L=18O 

Therefore, we may use Eq. (11.45), which yields 
kdet = cos (3.14 x 3/180) 1/3 = 0.93 


When the input to a diode detector is an AM wave, then, subject 
to Eq. (11.36), the output voltage of the detector at any time is 
proportional to the instantaneous amplitude of the input signal (the 
modulated carrier). 


11.6 Response of Lag-Free (Zero-Memory) 

Nonlinear Circuits to Stationary Random Signals 


Suppose that the input to a lag-free (zero-memory) nonlinear 
system is a random signal x(t) which is a realization of a stationary 
random process X ( t ). The output signal y ( t ) is connected to the 
input signal by a relation of the form 

y(f)=f(x{t)) 

The ensemble of realizations y(t) specifies a stationary random 
process Y(t). We are to find the relation between the statistical 
characteristics of the processes X (t) and Y(t). This can be done, 
using any one of two approaches. 

1. The nth-order multivariate probability density function of the 

input random process, p(x v x 2 . x n ; t v t n \ is known and we 

are to find a similar function, p(y lt y 2 , • ••> yni t v ..., t n \ for the 
output process. 

2. Acting within the framework of correlation theory, we set out 
to find the mean m y and the autocorrelation function K y (z) of the 
output random process. In addition to the autocorrelation function, 
it may be of interest to find the power spectrum W y ( co) of the out¬ 
put signal. 

The probability density of the output signal after nonlinear 
transformation. The first objective is achieved by using the techni¬ 
ques set forth in Chap. 6 for the probability densities of systems of 
random variables subjected to functional transformations. If x 1? x 2 , 
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x n are the random variables observed at the input at times t lf 
t 2 > •••> t n , respectively, then, since the transformation is lag-free, we 
will have at the output and at the same instants of time the 
following variables 

yi=f(x 1 ), y 2 =f(x 2 ), y n =f(x n ) (11.46) 

By using the inverse function x = cp (y), we have 
*1 = <P(yiX x 2 = v(y 2 ), *n=<p(y«) (11.47) 

The multivariate probability density for the output process is 
PoutG'i. yn) = Pin((p(y 1 \ <p(yn))\D\ (11.48) 

in which the Jacobian D has a very simple form 


In the case of multi¬ 
valued functions, a sum 
should be taken of the 
contributions from all 
branches 


D = 


d<p Or) 

0. 

dTi 

0 

dcp {y 2 ) 

d y 2 

0 

0. 


d<p(y„) 

dy„ 


dcp 
d y 


dcp 

dcp 

y=yi d y 

y=y 2 d y 


y=y„ 


(11.49) 


Equation (11.48) yields the solution in the most general form. It 
is to be noted that the structure of the Jacobian determinant (11.49) 
stems from the assumption that the transformation involved is 
a lag-free (zero-memory) one-the instantaneous value of the output 
signal solely depends on the input signal at the same instant of 
time. 


Example 11.6. A lag-free (zero-memory) nonlinear element having 
the piecewise-linear characteristic 



x > 0 
x <0 


(11.50) 


is driven by a Gaussian random process X (t) of mean value zero and 
with a specified variance a 2 . The probability density function of the 
input signal is 


Pm(x) = 


]/2no x 


exp( - x 2 /2cr 2 


Find the probability density function of the output signal. 
For x > 0, the inverse function has the form 



x = y/a 
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H 


y( 0 

I t 



and so 
dx/dy = 1/a 
Therefore, 

Pout GO = 


]/2n(j x a 


exp( — y 2 /2o x a 2 


for y > 0. For any negative value of x there is only one value y — 0. 
To assure the normalization of the probability density function for 
the output signal, we should allow a 5-singularity in the output 
probability density poutOO for y = 0 with a coefficient equal to 1/2: 


Pout GO = 


^-S(y) + -~r= -exp( — y 2 /2<j x a 2 ) for y^0 

1 ]/2n<j x a 


for y < 0 


(11.51) 


The mean value of the signal at the output of a nonlinear system. 
The simplest statistical characteristic of a stationary random 
process is its mean obtained by averaging its realizations over the 
ensemble or, if the process is ergodic, over one sufficiently long 
realization. In order to be able to find the mean of a signal 
subjected to a nonlinear, lag-free (zero-memory) transformation, we 
should have at our disposal the univariate probability density 
function PoutOO- Then 
00 

y = m y = J ypout(y)dy (11.52) 

— OO 

Thus, the problem reduces to finding a quadrature. With equal 
success, we could find the mean of a transformed signal by 
averaging the function /(x) with the aid of the univariate 
probability density function of the input signal: 

OO 

y= | /WPinWdx (11.53) 

— OO 


Example 11.7. Find the mean of the output signal for the system of 
Example 11.6. 

By Eq. (11.53), 

j OO 

y = —r=r j (ux/a x )exp( — x 2 /2aj) dx = aa x /]/2n = 0399ao x (11.54) 
1/ 2k o 
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The result implies that the variance of a stationary Gaussian 
process can be measured with the aid of a nonlinear converter 
having a characteristic of the form defined in (11.50), connected in 
cascade with a sluggish linear network which performs averaging 
over time. 


The autocorrelation function of the output signal. By the general 
rule, the autocorrelation function of the signal y(t) at the output of 
a lag-free nonlinear converter is 

Ky(x) = y(t)y(£ + x) - y 2 

00 

= II /(x)/(x T )pin(x, x T ; x)dxdx T -y 2 (11.55) 

— 00 


So that we could make use of Eq. (11.55), we should know p[ n (x, 
x x ; x) which is the bivariate probability density function of the 
input signal observed at two sections separated by a time interval x. 

Calculations by Eq. (11.55) may prove fairly cumbersome. The 
final result in a more or less observable form can only be obtained 
for a normal input process when 


Pin(x, x x ; t) = 


1 

2nOx(l ~ Rx) 1/2 ^ 


x 2 4- x 2 — 2 R x xx x 
2v 2 (1-R 2 ) 


(11.56) 


where R x ( x) is the correlation coefficient for the input signal. 


Example 11.8. Find the autocorrelation function of the output 
signal under the conditions given in Example 11.6. 

The main difficulty is to find the mean product 


00 00 


a 2 

* 

/ » 

xx x 

x 2 + x 2 2 R x xx x 

n 


2o 2 (1-R 2 )'' 2 6XP 

i 

1 

bo 

Q 

1 

>3 

1_ 


0 0 


By a change of variables, 


a x 1/2(1 -R*)’ T o x ]/2(l-R*) 
we may write the mean product as 

yy T = —a 2 o 2 x (l - Rl) 3/2 I 
n 

where 

00 00 

I = I I &texp( — % 2 - # + 2R x ^ x )d^ x 
0 0 

The simplest way to evaluate the last integral is by changing to 
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polar coordinates: 

£, = pcos cp, = psin cp 

Omitting simple, but cumbersome calculations, the final result is 

1 = 4(1 -R^ 7f + R* arc cos (- Rj] 

Hence, using Eq. (11.54) we find the autocorrelation function of the 
output signal: 

2 2 _ 

Ky(x) = ^[j/T^ + R x arccos( - R x ) - 1] (11.57) 

ZK 

Since for x = 0, the correlation coefficient is R x ( 0)= 1, the variance 
of the output signal is 

a 2 (j 2 

a 2 = K y ( 0) = x (tt - 1) = 0.3408 a 2 a 2 (11.58) 


▲ 

Work Problems 6 
and 7 


Therefore, the correlation coefficient of the random process at the 
output of a piecewise-linear nonlinear converter is given by 

R y {x) = []/l - R\ + R x arc cos (- R x ) - 1] (11.59) 


Nonlinear transformations of narrowband random processes. 
Suppose that the input to a lag-free (zero-memory) nonlinear 
converter is a Gaussian narrowband random process. Its 
realizations are quasiharmonic random waves with central fre¬ 
quency co 0 . The autocorrelation function of the input signal is 

K x (x)= g 2 x R x {x) = ct2p(t)£oscd 0 t (11.60) 

Let us find the autocorrelation function of the output signal with 
special reference to the piecewise-linear element examined in the 
previous examples. The direct substitution for R x from (11.60) into 
(11.59) yields the desired result, but this technique is not so obvious. 
It is advantageous to rearrange Eq. (11.59) by expanding its right- 
hand side into an infinite series in powers of R x (t). To this end, we 
will take advantage of the fact that 

arc cos ( — R x ) = tt/2 + R x + R%/6 + ... 

and 

|/l — -Rx = 1 — Rx/2 — Ri/8 — ... 

Therefore, 

R y ( T ) = — - - - (kRx/2 + R 2 /2 + R.y 24 4 -...) 

71 - i 


(11.61) 
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On the basis of (11.60) we find that 


1 r n 

Ry(y) = -~ — P(X)COS© 0 T + l/2p 2 (t) 

K — 112 

x cos 2 ovt + l/24p 4 (x)cos 4 (D 0 x + ...] (11.62) 

Since 

The effect of the 2 . 

higher terms in the cos 0)01 ” ^ + 1/2cos2co 0 t 

expansion is negligible and 


cos 4 co 0 t = 3/8 + l/2cos2co 0 x + 1/8cos4co 0 t 


it follows from (11.62) that 
^(T)^0.117p 2 (x) + 0.007p 4 (x) + O.733p(x)cosco 0 x 
+ [0.117p 2 (x) + 0.01 p 4 (x)] cos 2co 0 x 

+ 0.002p 4 (x) cos 4co 0 x 

0 (jJq 



(11.63) 


A 


j— & —i 


0 u>o 2u) 0 4u) 0 6 u)q 


Hence, by taking advantage of the W-K theorem, we are able to 
identify the form of the power spectrum F y (©) of the output 
random process. As it turns out, the power spectrum of the wave at 
the output of the nonlinear converter in question breaks up into an 
infinite sum of components each of which represents an individual 
narrowband random process. The “masses” (peaks) of their power 
spectra are observed at frequencies © 0 , 2© 0 , 4co 0 , .... Also, the 
power spectrum of the output signal includes a low-frequency 
component in the vicinity of the zero signal, which may be looked 
upon as the outcome of the amplitude detection of the input sig nal 
It is interesting to note that in this special case the spectrum of 
the output signal does not contain components at frequencies 3co 0 , 
5© 0 , .... Undoubtedly, should the nonlinear element have any other 
form of characteristic, we might expect the appearance of all 
harmonics of the central frequency of the input random wave. As 
a rule, the intensity of the high-frequency spectral components 
rapidly falls off with increasing harmonic number. 


Summary 

<X> The real current-voltage characteristics of lag-free (zero-memory) nonlinear one-ports 
can be approximated with a variety of simple functions. Most frequently, use is made 
of piecewise-linear, power and exponential approximations. 

W The current flowing in a lag-free (zero-memory) one-port driven by a harmonic 
excitation contains in the general case a d. c. component and an infinite number of 
harmonics, that is, waves at frequencies which are multiplies of the input-signal 
frequency. 

v* The output voltage of a tuned amplifier operating in the nonlinear mode is a sinewave 
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owing to the frequency-selective behaviour of the tuned circuit, despite the 
nonharmonic nature of the current flowing through the tuned circuit. 

<C>0 When the input signal has a large amplitude, the tuned amplifier is operating in the 
overdriven mode. 

00 The response of a nonlinear element to a sum of harmonic signals differing in fre¬ 
quency contains waves at intermodulation frequencies. 

<00 The filtering of appropriate intermodulation waves makes it possible to effect both 
amplitude modulation and amplitude demodulation (detection). 

00 Under a lag-free (zero-memory) nonlinear transformation, a Gaussian random process 
gives rise to a non-Gaussian random process. 

00 In order to find the autocorrelation function of a random process at the output of 
a nonlinear converter, one has to have the bivariate probability density function of the 
input signal. 

Review Questions 

1. Define the condition under which the nonlinear transformation of a signal may be taken 
as being lag-free. 

2. What current-voltage characteristic must a nonlinear element have for its output current 
to be free from odd harmonics? 

3. Define the considerations governing the choice of the cut-off angle for a large-signal 
tuned amplifier. 

4. State the physical principle underlying the operation of a nonlinear frequency multiplier. 
Why is it that a high multiplication factor is difficult to achieve? 

5. Define the considerations governing the choice of the load parameters for an AM 
detector. 

6. What is the difference between linear and square-law detection? 

7. What determines the choice of the cut-off angle for a diode detector? 

8. Describe the calculation of a univariate and a multivariate probability density function 
for a random process after it has been subjected to a lag-free (zero-memory) nonlinear 
transformation. 

9. What is the salient feature of the nonlinear transformation of narrowband random 
processes? 


Problems 

1. A nonlinear one-port has a current- 
voltage characteristic (mA) of the form 

i{v)=10v 3 

What is the analytic expression for this 
characteristic in the vicinity of the operating 
point V 0 = 2 V? 

2. A harmonic tuned amplifier is set up as 
shown in Fig. 11.6. The characteristic of the 
transistor (mA) is approximated by two 


straight-line segments: 


. . x f 50(i>be — 0-2) for r> BB > 0.2 V 
* c(i;be) = {o for , BE < 0.2 V 

The tuned-circuit impedance at resonance is 
^res = 0.8 k£l The supply voltage is E sup = 
= 9 V. The operating point is positioned at 
the kink of the characteristic. Find the 
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amplitude of the input signal that will 
overdrive the amplifier. 

3. A nonlinear lag-free (zero-memory) 
element has a current-voltage characteristic 
of the form i(v) = a 0 rk,a 1 v +a 4 v*. 

The voltage applied to the element is 
v(t)= V mi COSGV+ V m2 cos(o 2 t 

Find the amplitudes and frequencies of all 
the intermodulation components of current. 

4. There is a nonlinear resistor whose 
characteristic (mA) has the form 

i(v) = 25v + 4v 2 


Advanced Problems 

8. Analyse the free response of 
a nonlinear system which is a parallel LC 
tuned circuit shunted by a crystal diode. 



9. Analyse the operation of the balanced 
modulator shown in the accompanying 
circuit diagram: 


The voltage applied to the resistor is given 
(in V) by v = 5 -I- 2 cos £lt -h 1.5 cos co 0 f. 
Find the amplitude of the carrier and the 
depth of modulation. 

5. There is a diode detector built around 
a crystal diode whose transconductance is 
g m =10mA/V. The load resistor is Rl = 
= 20 kfl The applied AM signal (in V) is 
given by v(t) = 5(1 + 0.6 cos Clt) cos a> 0 £. 
Find the amplitude of the low-frequency (fl) 
signal developed across the detector load. 

6. There is a nonlinear device which is 



The input of the limiter accepts a Gaussian 
stationary random process X (t) of mean 
value zero and of variance <j% Plot for the 
output realization. Find the mean and the 
variance of the output signal. 

7. A lag-free (zero-memory) nonlinear 
element has a characteristic of the form y = 
= a | x | and is driven by a Gaussian 
stationary noise of mean value zero and 
with an autocorrelation function K x (x) = 
= o 2 R x (z). Find the expression for the 
autocorrelation function of the output 
signal. 



The tuned circuit in the collector lead is 
tuned to co 0 . Show that, if the circuit is 
completely symmetrical, the output signal 
will not contain a component at the carrier 
frequency. 

10. Show that the diode detector set up as 
shown in the accompanying schematic 


—0 

C 

—0 

diagram has an input impedance of R{ n = 
= Ri/2. The input impedance is defined as 
the ratio of the amplitude V m of the input 
voltage to the amplitude of the fundamental 
component I mi of the input current. 

11. Propose a circuit capable of 
demodulating angle-modulated signals. The 
circuit should include a linear frequency- 
selective network and an amplitude detector. 



Chapter 12 

Signal Transformations 
in Linear Parametric Circuits 


Linear systems described by time-dependent nonstationary 
system operators T(t) possess a number of properties of interest 
and value for communication engineering applications. Here, the 
input signal is transformed as defined by 


»out(f) = T(t)v- m {t) (12.1) 


such that, owing to the linearity of the system, 

T ( t ) (oCj Vim T- a 2^in2) = a i ^ M ^ini + a 2 ^ (0 ^in2 (12.2) 

for any constants oq and a 2 . 

Circuits described by Eq. (12.1) are called parametric. The name 
arises from the fact that such circuits always contain elements 
whose parameters are time-dependent. The parametric devices most 
commonly used in communication applications are resistors R ( t\ 
capacitors C(t), and inductors L(t). 

A salient feature of a linear parametric system is the inclusion of 
an auxiliary oscillator which controls the parameters of the circuit 
elements. 

The prominence given to parametric circuits in 

telecommunications is due to the ability of such systems to 
transform the spectra of input signals, and also to the possibility of 
building low-noise parametric amplifiers. 

12.1 Response of Resistive Parametric Circuits 

A parametric circuit is called resistive (zero-memory ), if its system 
operator is a number k(t) which depends on time and serves as 
a coefficient of proportionality between the input signal v m {t) and 
the output signal i; O ut(0- 

p out(§aj*w»in(t) (113) 

The simplest system of this type is a parametric resistor of 

resistance R(t). The relation connecting the instantaneous values of 
voltage and current in this one-port is 

v(t)=R(t)i(t) (12-4) 

Alternatively, a resistive parametric element may be described in 
terms of the time-variant conductance 

G{t)=l/R(t) 


Input Output 


Parametric element 


Control oscillator 


The resistive paramet¬ 
ric network 
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The spectrum of the current in a resistive parametric one-port. As 
a rule, the control signal applied to the parametric element from an 
external auxiliary source is periodic in time. Therefore, in studying 
signal transformations in resistive parametric elements, we will 
concentrate on the controlled resistor whose conductance G(t) is 
representable by a Fourier series: 

00 



G(t) = G 0 /2+ £ Gfccos(/cco c t- 'F t ) (12 5) 

k= 1 

where co c is the frequency of the control oscillator, and G 0 , G n 
G 2 , ... and Tj, '1' 2 - ••• are constant numbers determining the 
t amplitudes and phases of the corresponding harmonics in the 
conductance spectrum. 

Let the resistive parametric one-port be driven by a harmonic 
signal voltage 


v(t)= V m cos ((D s t + cp s ) 


Then the current in the one-port will be 


i(t)=G(t)v(t) = 


VmG 0 

2 


cos (co s t 4- cp s ) 


▲ 

Solve Problem 1 


The spectrum of cur¬ 
rent in a resistive pa¬ 
rametric one-port 


00 

+ £ VmGkCOS (kco c t — \F&) cos (co s £ + cp s ) 

k= l 

Vm G p/ oo 

= y^ cos (<M + <Ps) + ~~ Y G k COS [(C0 S + ka c ) t 

A *■ k=l 

y 00 

+ tps - 'f'fc] + ~ Y GkCos [(co s - /cco c ) t + <p s + 'Ffc] (12.6) 

^ k= 1 


Equation (12.6) can be simplified by taking sums over the 
positive and negative indices k, noting that G k =G_ k and V F/ C = 
— ^-k, so that 


Em 6?o / 2 










JJ 

I 

I 

J- 


O V) O o 

3 3 3 3 

I +2 

CO C/3 + 

3 3 | 


+ 00 


i (t)= 1 / 2 V m £ Gfccos[(©s+ k&c)t + (p s -'¥ k '] 

k= - oo J 


(12.7) 


Equation (12.7) defines the spectral composition of the current in 
a resistive parametric one-port: This current contains a component 
at the signal frequency with an amplitude V m G 0 f 2, and also 
a number of intermodulation waves at frequencies co s + kco c (k = 
±1, ±2, ±3,...) and with amplitudes K m G*/2. The spectral 
diagram of the current is symmetrical about co s . 

It may be noted that in a sense the spectral composition of the 
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current in a parametric resistor is simpler than that in a lag-free 
(zero-memory) nonlinear element. For one thing, it does not 
contain any harmonics of the signal frequency. 



The parametric net¬ 
work with a resistor 
and a switch 



G(t ) 

/ 

l/R 


, W c t 


i i » i- 

-n-&o 0 0 0 n 




Example 12.1. Consider a parametric network formed by a fixed 
resistor R and a switch which connects the resistor periodically to 
a voltage source v{t)= F m cosco s t. The period of the control signal is 
T c . The switch operates so that during the time interval (—TJ2, 
Tq/ 2) the circuit is completed for all t's satisfying the condition 
— $ 0 < co c t < & 0 , and is open for the remaining instants of time. Find 
the amplitudes of all spectral components of the current. 

As follows from the statement of the problem, the conductance 
G(t) of the network is an even function that can be expanded into 
a Fourier series of the form (12.5) only in terms of cosines with zero 
initial phases TV The corresponding Fourier coefficients are 

So 

G k = (2/nR) f cos k$ d£ = (2/knR) sin k& 0 (12.8) 

— 9 0 

The intermodulation current components at frequencies co s + /cco c 
will have the amplitudes 

Ik = (Ym/knR) sin /c$ 0 (12.9) 

Interestingly, if the input signal and the control wave are 
synchronous (co s =co c ), a steady (d.c.) component will be present 

f dc = (Vm/TzR)^tn $0 5 k = - 1 


The effect of current In lh e circumstances, the parametric network operates as a rectifier: 
rectification at the current is produced only by the positive half-cycles of the cosine 

0 = 90° wave. 

Implementation of resistive parametric elements. In practice 
parametrically controlled resistors are implemented as follows. 

A lag-free (zero-memory) nonlinear one-port whose current-voltage 
characteristic is i =f (y) is driven by a sum of two waves: the 
control voltage v c (t) and the signal voltage v s (t). The control 
voltage is chosen to be substantially greater in magnitude than the 
signal. The current thus produced in the nonlinear one-port may be 
written by expanding the current-voltage characteristic in a Taylor 
series in terms of the instantaneous value of control voltage: 

i =f(v c + Vs) =f(v c ) +f (v c ) Vs + y/" (v c ) v\ + ... 


( 12 . 10 ) 
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The dynamic trans¬ 
conductance is deter¬ 
mined by the “large” 
control voltage 


The intermediate fre¬ 
quency 



v lo ~ 1 - 

Frequency converter 


The signal amplitude is chosen so small that we may neglect the 
second and higher powers of i> g (t) in Eq. (12.10). By using Ut) to 
designate the increment in the current through the one-port due to 
the presence of the signal, we get 


h(t)xf'(v c (t))v s = gd(v c (t)) v s 


( 12 . 11 ) 


As is seen, the dynamic transconductance (the slope of the current- 
vohage characteristic) is determined by the “large” control voltage. 

The most important applications of resistive parametric elements 
will be discussed in the pages that follow 
Frequency conversion. This refers to the transformation of the 
spectrum of a modulated signal, consisting in that the modulated 
signal is translated from the vicinity of the carrier frequency co car to 
the vicinity of some intermediate frequency co;, such that the form of 
modulation remains unaffected. 

A frequency converter (also called a frequency changer) consists of 
a mixer which is a lag-free parametric element, and a local oscillator 
operating at frequency coi 0 which serves to control the mixer 
parametrically. The local-oscillator voltage causes the dynamic 
slope of the current-voltage characteristic of the mixer to vary 
periodically in a manner defined by 

9d(t ) = go F 9i cos coiot + g 2 cos 2co] 0 t -(-... ^2 12) 

If the input to the frequency converter is an AM signal 
v s(t) = V m (l + M cos Qt) cos co s t 

then, by virtue of Eqs. (12.11) and (12.12), the output current will 
contain a component defined by 

*sW= V m (l + Mcos Qt)|> 0 cos co s t+ 72 0 icos(coi o -co s )t 


+ V 2 9i COS ((Bio + CDs) t + 1 / 2 g 2 COS (2c0i o - C0 S ) t 

+ 72-02 cos ( 2 oaio +oo s ) t.„] 


Customarily, the intermediate frequency (i.f.) is chosen such that 
C 0 i — Jcoio — co s ). The current at the intermediate frequency 


h{(t) = 


Ql Vm 

~Y~ 


(1 + M cos Clt) cos coi t 


(12.13) 


is an AM wave modulated in the same manner as the input signal. 

In order to extract the spectral components at frequencies close 
to the intermediate frequency, the output circuit of the frequency 
converter includes a tuned circuit tuned to coj. 
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Fig. 12.1 Block diagram of a superheterodyne receiver 

Frequency conversion is widely used in superheterodyne receivers. 
A block diagram of a superheterodyne (or superhet) receiver is 
given in Fig. 12.1. It operates as follows. The signal picked up by 
the antenna is conveyed via the input circuits and an r. f. amplifier 
(RFA) to the frequency converter. The output signal of the fre¬ 
quency converter is a modulated wave whose carrier frequency is 
equal to the intermediate frequency of the receiver. The bulk of 
receiver amplification and receiver selectivity is assured by 
a narrowband i.f. amplifier (IFA). 

An important distinction of a superhet receiver is that its 
intermediate frequency remains unchanged. In tuning a superhet 
receiver, one only has to vary the tuning of the local oscillator and, 
in some cases, of the tuned circuits that may be present in the input 
circuits and in the RFA. 

It is to be noted that the frequency converter responds equally to 
two frequencies, namely co S i = ®io + and co S2 = coi 0 — coi. In radio 
engineering, it is customary to say that reception is possible over 
both the main channel an3 its image channel. To avoid ambiguity 
in receiver tuning, the selectivity of the resonant circuits placed 
between the antenna and the frequency changer is adjusted in such 
a way that practically all of the image-frequency signal is rejected. 

Conversion transconductance. The effectiveness of a frequency 
converter is customarily stated in terms of a special parameter 
called the conversion transconductance, g c . It is defined as the ratio 
of the amplitude of current at the intermediate frequency to the 
amplitude of the unmodulated signal voltage: 

Qc = I m,\iJV m, s 

As follows from Eq. (12.13), 


Q c = gJ^ 


(12.14) 


The operating prin¬ 
ciple of the superhet 
receiver 


Amplitude 

response 



w lo-^i w lo ^lo+^i 


Image rejection 


Conversion transcon¬ 
ductance 


Or, in words, the conversion transconductance is equal to half the 
fundamental of the dynamic transconductance of the parametric 
element. 
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Suppose that the nonlinear element included in the frequency 
converter has a quadratic current-voltage characteristic: 

i(v) = bv 2 

In the no-signal condition, the element is driven by the sum of the 
bias voltage and the local-oscillator voltage: 

v c = V 0 + V m ,\ 0 cos COlo t 

The dynamic transconductance of the frequency converter varies in 
time as given by 

gd= 2bv c = 2bV 0 + 2hF m ,i 0 cos coi 0 t (12.15) 

Referring to (12.14), we can see that in this case 

g c =bV m do (12.16) 

Thus, with the input signal held constant, the amplitude of the out¬ 
put signal of the frequency converter is directly proportional to the 
amplitude of the local-oscillator voltage. 

Let us illustrate the calculation of a frequency converter with 
a simple example. 

Example 12.2. A frequency converter uses a nonlinear element (a 
transistor) whose current-voltage characteristic is i c =20t;|E, so that 
b = 20 mA/V 2 . The tuned circuit in the collector lead has a resonant 
resistance R res = 3 k£L The amplitude of the unmodulated input signal 
Is L m?s =50 nV, and the amplitude of the local-oscillator voltage is 
L m ,io = 0-5 V. Find the amplitude of the i.f voltage at the converter 
output, V m ,if- 

From Eq. (12.16), the conversion transconductance is 
g c =20 x 0.5 = 10 mA/V 

The amplitude of the output current at the intermediate frequency 
is 

Im,if — gcV m,s = 0.5 jiA 

Assuming that the output impedance of the transistor is 
sufficiently high for its shunting effect on the tuned circuit to be 
negligible, the amplitude of the i.f. voltage is 

V m ,if = 1.5 mV 


Synchronous detection. Suppose that the local oscillator of a fre¬ 
quency converter is tuned exactly to the signal frequency, and, in 
consequence, the dynamic transconductance varies in time as given 
by 

gd(t) = g 0 + gi cos CO s t + g 2 cos 2co s t + ... 


A 

Work Problem 3 
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If the voltage applied to the frequency converter is an AM signal 
defined by 

v s (t) = y m , S (1 +M cos f)£)cos(GV + cp s ) 

the current due to the signal voltage will be 

i s (t) = V m,s(l + M cos Qt) [g 0 cos (co s t + cp s ) 

+ V 2 01 cos (2co s f + cps) + V 2 0 i cos 9s + ...] (12.17) 


Here the expression in the square brackets contains a steady (d. c.) 
component, (gJ2) cos cp s , which depends on the phase shift between 
the local-oscillator voltage and the input-signal carrier. Therefore, 
the spectrum of the output current acquires a low-frequency 
component 

i\f(t) = (L m ,s0i/2)(1 + M cos Clt) cos cp s (12.18) 


This current faithfully reproduces the message being transmitted. 

A synchronous detector (or synchronous demodulator) is a fre¬ 
quency converter operating subject to the condition coi 0 = co s . In 
order to extract the useful signal, the output circuit includes 
a low-pass filter, such as a parallel RC-network. 

In practice, the use of a synchronous detector is handicapped by 
the fact that an exact phase relation must be maintained between 
the input-signal carrier and the local-oscillator voltage. The best 
choice is cp s = 0°. If, on the other hand, cp s = 90°, the useful output 
signal vanishes. However, this sensitivity of a synchronous detector 
to the phase shift can be utilized in measuring the phase relations 
between two coherent waves. 

The example that follows illustrates the calculation of a specific 
type of synchronous detector. 



The synchronous de¬ 
tector (demodulator) 


i c,mA 



Example 12.3. A synchronous detector is built around a transistor 
whose characteristic ic=f(^BE) Is approximated with two straight- 
line segments. The approximation parameters are: g m = 50 mA/V and 
y c = 0.3 V. The amplitude of the local-oscillator voltage is 0 = 
= 1V; the direct bias voltage is zero (F o = 0). The unmodulated 
signal voltage with an amplitude F m?s = 25 pV is shifted in phase 
relative to the local oscillator through an angle cp s = 45°. Find 
variations in the d. c. voltage at the output of the synchronous detector 
caused by the useful signal, if Rl= 1-2 k£l 
In the case of a piecewise-linear nonlinear element the dynamic 
transconductance (the slope of the current-voltage characteristic) 
may take on only two values: 



v c < y cutoff 
Vc>y cutoff 
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Therefore variations in the dynamic transconductance with time 
can be represented by a periodic series of rectangular video pulses. 
The cut-off angle 9 which defines the duration of the pulses can be 
found from (see Chap. 2) 

9 = arc cos f ^ cutoff ~ ^ 0 . ) = 72.5° 

\ V m,lo / 

In order to determine the amplitude of the fundamental term of 
the transconductance, we may use Eq. (12.8) in which the 
conductance 1/R is replaced with g m , the transconductance of the 
transistor within the active region of the characteristic. Then 

g 1 = (IgjTi) sin 0 = 0.607g m = 30.35 mA/V 

In accord with Eq. (12.18), the useful signal brings about the 
following increment in the current flowing through the transistor: 

A i = (F m5 s0i/2)cos cp s = 0.268 \xA 

Hence, variation in the direct voltage level at the output of the 
synchronous detector is 

Av = — Az'jRl = — 0.32 mV 


£m 

2d 


1 



i w lo 


-n -d 0 d 7t 


12.2 Energy and Power Relations 

in Reactive Parametric Elements 


The pump oscillator 


An increase in the spa¬ 
cing between the plates 
of a capacitor leads 
to a decrease in its 
capacitance 


Reactive parametric elements, that is, those in which either the 
capacitance, C(t), or the inductance, L(t), is varying with time, 
display a whole range of spectral properties. Taking 
a parametrically controlled capacitor as an example, we will 
demonstrate that, given certain conditions, such elements can act as 
“intermediaries” which transfer power from external control 
sources, called pump oscillators, to circuits carrying the useful signal. 
This principle underlies parametric amplification which will be 
studied in the next section. 

Relation between the capacitance of a capacitor and the stored 
energy. To get proper insight into the physical foundations of the 
processes taking place in reactive parametric circuits, let us consider 
the following idealized system. Let a flat capacitor whose plates are 
spaced a distance x 0 apart, be charged to a voltage V 0 . The 
capacitor carries a separated charge Q = CV 0 , where C is its 
capacitance. 

Suppose that by some mechanical means the capacitor plates are 
moved apart and the spacing between them is increased to x 0 + dx. 
The displacement is directed against the electric-field force which 
tends to move the capacitor plates closer together. In overcoming 
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the field force, external forces have to do some positive work on the 
system, with the result that the field energy stored in the capacitor 
is increased. 

In order to obtain quantitative results, we note that the original 
energy stored in the capacitor is 

E = Q 2 /2C (12.19) 

When the capacitance is incremented by dC, the energy increment 
is 

dE = — (Q 2 /2C 2 ) dC = - E d C/C (12.20) 

because there is no conduction current flowing, and the charge 
Q remains unchanged. On finding the capacitance C from the 
equation for a flat capacitor (known from physics), 

C = s qA/xq 

(where A is the surface area of a capacitor plate), we obtain the 
following expression for the relative increment in capacitance: 

dC/C = — dx/x 0 

On inserting the above result in (12.20), we get 

dE = Edx/x 0 (12.21) 

As should be expected, Eqs. (12.20) and (12.21) show that in order 
to increase the electric-field energy stored in a system, the 
capacitance of the charged capacitor must be decreased by some 
external factors. 

Parametric excitation of a resonant circuit. So long as the 
capacitor charge Q is held constant, no continuous inflow of energy 
into the system can be brought about by varying the capacitor 
capacitance about some mean value. The point is that on doing 
a positive work over the time interval while the capacitance is 
decreased, the external source will receive from the capacitor the 
same amount of energy during the next time interval when the 
capacitance is increased. Naturally, the energy averaged over 
a period (or cycle) will be zero. 

The picture is entirely different in a resonant circuit when the 
voltage across the capacitor due to the free process crosses zero and 
changes sign. Consider a high-Q resonant circuit formed by a fixed 
inductance L, a parametric capacitance C{t), and a loss resistance 
R. Suppose that in some unspecified manner natural (free) 
oscillations have been produced in the tuned circuit. Neglecting the 
insignificant decrease in the amplitude of the oscillations due to 
losses, let us take it that V m ,c , the amplitude of the voltage across 
the capacitor, varies in time at the frequency of natural (free) 


The electric constant 

8 0 = 10“ 9 /36tc 
= 8.842 x 10" 12 Fm" 1 


R 



12-728 
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c(t) 


Note that energy is 
supplied to the tuned 
circuit twice every pe¬ 
riod of natural oscilla¬ 
tions 


It is taken that 

P®b«t = 1/ C 0 


oscillations 
®nat = 1/l/LCo 

where C 0 is the mean capacitance of the parametric capacitor. 

Assume that the capacitance of the capacitor varies periodically 
in the following manner: Twice over a period of natural oscillations 
the capacitance undergoes a negative-going jump by AC at the 
instants when the voltage across the capacitor is at an extremum 
(positive or negative), and is restored to its original value or, which 
is the same, undergoes a positive-going jump by the same amount 
at the instants when the voltage across the capacitor crosses zero. 

This pumping action will result in a unidirectional flow of energy 
into the resonant circuit. Indeed, the work done by external forces 
at the instants when a negative change of capacitance takes place 
will always be positive, irrespective of the sign of the voltage across 
the capacitor. On the other hand, no energy will be expended at the 
instants when the voltage across the capacitor is zero and there is 
no electric field to give rise to forces of repulsion. 

If 

£c,max = j V 2 m ,c(C 0 + AC/2) X J V 2 m ,c C 0 

is the maximum energy stored in the capacitor, then, in accord with 
Eq. (12.20), the energy pumped into the tuned circuit over a period 
of natural oscillations will be 


Epump — 2Ec,max AC/C 0 — Fj^.cAC (12.22) 

At the same time, the mean power lost in the tuned circuit will be 


Floss — - ImR — 


1 V 2 m,C 

2 p 2 


R = 


1 Vic 

2 P Q 


(12.23) 


The total power dissipated in the resistor over a period of 
oscillations, T, will be 


Eioss - Ejoss T — V^yi'CCon/Q (12.24) 

If the equality 

-Epump = Eloss (12.25) 

is satisfied, the pump source will make up for the losses in the 
tuned circuit. If, on the other hand, E pU mp>Eioss, the system will 
turn unstable, and the amplitude of the oscillations in the circuit 
will build up exponentially - the oscillatory circuit is said to be 
excited parametrically. From Eqs. (12.22) and (12.24), we can derive 
the following relation defining the critical relative variation in 
capacitance: 


ACcr/Co — n/Q 


(12.26) 
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As a rule, the values of AC cr are small. As an example, for 
parametric excitation of a tuned circuit with C 0 = 20 pF and Q = 
= 100, it will suffice for AC to be 0.63 pF. 

In the above analysis, we proceeded from the assumption that the 
pump signal changes the capacitance of the capacitor twice over 
a period of the natural oscillations. It is easy to see, however, that 
the parametric excitation of the oscillatory system will take place 
also when the fundamental frequency of the pump voltage is 
copump = ®nat J n (n = 1, 2, ...). What is important is that the spectrum 
of the pump signal should contain a component at frequency 2a> n at- 
It is also required that a precise phase relation be maintained 
between the natural oscillations of the tuned circuit and those of 
the pump oscillator. A shift of the pump signal by a half-cycle in 
phase so that the positive change of capacitance occurs at the 
instants when the voltage across the capacitor passes through an 
extremum will cause the parametric capacitor to act as an 
additional resistive load instead of as an energy source. 

Relation between the voltage across and the current in 
a parametric capacitor. Consider a circuit formed by a source of 
signal voltage 


The requirements 
that the pump should 
meet in order to as¬ 
sure the self-excitation 
of the tuned circuit 


v(t)= V m COS{(O s t + cp s ) 


and a controlled capacitor whose capacitance varies in time 
harmonically at the pump frequency: 


C ( t ) — Co [1 + P COS (C0p um p t + Cppump)] (12.27) 

Here P is a coefficient defining the degree of modulation of the 
capacitance. Since the charge on the capacitor is 

q = C(t)v 

the current in the circuit is 


, x dC dv 
' ( = "dT I ’ +C "dT 


— — PcOpumpC 0 FmSin (C0p um p t + 9pump) COS (C0 S t + (p s ) 

-C0 S C O F m sin(co s ^ + 9s) 

— pco s C 0 V m cos (©pump £ + 9 pump) sin (co s £ + 9s) (12.28) 


Taking advantage of a known trigonometric formula 
cos x sin y = V 2 [sin ( x + T) — sin ( x ~ T)] 

we may write the products in the first and third terms on the right- 


12* 
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▲ 

Work Problem 4 


hand side of Eq. (12.28) as follows: 
sin (CDpump t + cppump) cos 4- (Ps) 

= 1 / 2 {sin [(CDs + COpump) £ + Cps + tppump] 

— sin [(C0 S — COpump) t + Cps — CPpump]} 

COS (©pump t "h Cppump) s i n (®sf 4* Cps) 

= V 2 { S ^ n [(®s 4- COp Um p) £4- Cps + Cppump] 

— sin [(COpump “ COs) £ + cppump — (ps]} 


(12.29) 


(12.30) 


Thus, 

i(t)= -co s C 0 E m sin(cos£ + cps) 
P C 0 V m 


+ ■ 


(COs — COpump) sin [(COpump — COs) £ 


n PC 0 V m 

+ Cppump ~ CpsJ-r——'(COpump + CO s ) 


X sin [(COs 4- COpump) £ + cp s + Cppump] 


(12.31) 


The mean power drawn 
by a one-port 
p = (VI/ 2)cos cp 

where cp is the phase 
angle between volt¬ 
age and current 


The choice of the pump 
frequency 


Equation (12.31) establishes the form of the current spectrum in 
a parametric capacitor. In addition to a component at the signal 
frequency, the spectrum contains two side frequencies, co s — co pum p 
and C0s 4- copump- 

The mean power drawn by a parametric capacitor at the signal 
frequency. Circuit theory tells us that for the mean power flux 
between a source and its load to be non-zero, it is required that, 
firstly, the current and voltage under harmonic conditions be 
described by functions of one and the same frequency, and, 
secondly, the phase shift between the current and the voltage be 
other than 90°. 

As follows from (12.31), the current flowing through a parametric 
capacitor always contains a reactive component at the signal 
frequency: 

/react (t) = - co s C 0 V m sin (co s £ + cps) 

Being in quadrature with the source voltage, this current does not 
dissipate power on the average. 

If, however, we choose a suitable pump frequency, one more 
current component can be added at the signal frequency. As follows 
from Eqs. (12.29) and (12.30), for this to happen it will suffice to set 
copump = 2co s • Then the current through the parametric capacitor 


Ch. 12 Signal Transformations in Linear Parametric Circuits 


357 


will acquire a useful component 
/ \ pCOs C 0 V m . . 

Wul (t) = --- Sin (C0 S £ + Cppump - CPs) 

The instantaneous power in the useful component is 

puseful (t) = V (£ ) /useful (t) 

PC0 S C 0 Vm , . . , 

= -^- C ° S f® 8 1 + W Sin (®s 1 + ^Ppump - Cps) 

pco sC 0 Vm r ^ ^ „ XT 

“ a L sin (2co s £ + cpp Um p) — sin (2cp s — cpp Um p)] 


(12.32) 


The power averaged over a period of the signal is 
1 T • 

P'dv — J Puseful(0^^ 
o 

P<JD S Cq Vm . 

=-^-sin (2cp s — cppump) (12.33) A 

Solve Problems 5, 6 

The equivalent circuit of a parametric capacitor. Equation (12.23) an( * ^ 
indicates that the average power may be positive or negative, 
depending on the phase relation between the input signal and the 
pump output. This implies that, through a suitable choice of the 
phase angles cp s and cp pum p, a condition can be secured in which 
a parametrically controlled capacitor will behave as an active 
circuit element by supplying, rather than consuming, power at the 
signal frequency. 

On writing = 2cp s — cp pum p, the average power in a parametric 
capacitor may be written as 

P av =V 2 J2Rin 

where 


R[n = 2/PcOs c 0 sin O (12.34) 


is the insertion resistance, that is, one introduced by this element 
into the circuit. Hence, the equivalent circuit of a parametric 
capacitor controlled by a pump oscillator at twice the signal fre¬ 
quency is a parallel connection of a capacitor C 0 and a resistor i^i n . 
If this element is to act as an oscillator, it is necessary for the 
insertion resistance to be negative. The average power delivered 
into the circuit increases with decreasing magnitude of the negative 
resistance. 
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Use of parametric 
amplifiers 


The varactor 


The charge-voltage 
characteristic 



A parametrically cont¬ 
rolled capacitance is 
implemented owing to 
the nonlinear beha¬ 
viour of the varactor 


B 



0 

The magnetization 
curve of a ferromagne¬ 
tic material 


12.3 Principles 

of Parametric Amplification 

The ability of controlled reactive one-ports to behave as active 
circuit elements under certain conditions is the basis of a special 
class of devices known as parametric amplifiers. They are mainly 
used at microwave frequencies as the input stages of highly sensitive 
receivers. The principal virtue of parametric amplifiers is the low 
level of internal noise, since they contain no sources of shot noise. 

Implementation of parametrically controlled reactive elements. 
Theoretically, the feasibility of parametric amplification was proved 
early in this century. It was not until the 1950s when the early 
successful parametric crystal diodes had been developed, that the 
idea could be realized. For their operation, parametric crystal 
diodes, more frequently called varactors , depend on the following 
effect. If we apply a voltage in reverse polarity to the P-N junction 
of a varactor, the separated charge q in the barrier layer will be 
a function of the applied voltage v. The relation q(v) is called the 
charge-voltage characteristic of a varactor. A change in the applied 
voltage causes a displacement current to flow across the 
reverse-biased junction 

i = dq/dt — (dq/dv)(dv/dt) = C d (v)dv/dt (12.35) 

where C d (v) is the dynamic (or incremental) capacitance of the 
varactor. It has been found that the dynamic (incremental) 
capacitance (pF) of a point-contact varactor is approximately given 
by 

C d (v)=C(0)/]/\ + 2|i>| (12.36) 

where C (0) is the dynamic capacitance at zero bias voltage, and v is 
the applied voltage, V. The higher the bias voltage, the smaller the 
dynamic capacitance. 

Present-day varactors show a high-quality performance and can 
operate at frequencies up to tens of gigahertz. 

It is also possible to build elements with a parametrically 
controlled inductance, L(t). These are coils with cores made of 
a ferromagnetic material whose magnetic induction B strongly 
depends on the bias current I .. At radio frequencies, however, 
variable-inductance elements (frequently called varindors) have not 
found any appreciable use because the cyclic magnetization of the 
material entails a marked time lag. 

The single-stage parametric amplifier. Consider the signal source 
formed by a conductance G s connected in parallel with an ideal 
source of current with amplitude I m . The signal source is loaded 
into a resistive load whose conductance is Gl . The voltage 
appearing between the circuit terminals is 

V m = Im/(Gs + G L ) 
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so the power in the load is 


Pl = 


1 Im G L 

2 (Gs + Gl) 2 


(12.37) 


A decrease in the conductance of the signal source leads to an 
increase in the power in the load. Thus, the effect of amplification 
can be achieved by reducing in some way the internal conductance 
of the signal source. One way to achieve this is to connect the 
signal source in parallel with a parametric capacitor whose 
capacitance varies at twice the signal frequency, and the initial 
phase of the signal is chosen such that the insertion resistance R[ n 
(see Eq. (12.34)) is negative. This principle is implemented in the 
simple single-stage parametric amplifier shown schematically in 
Fig. 12.2. 



Fig. 12.2 Single-stage parametric amplifier: (a) schematic diagram; ( b ) 
equivalent circuit 


Referring to Fig. 12.2, the auxiliary inductance L and the 
capacitance C 0 (see Eq. (12.27)) make up a parallel resonant circuit 
tuned to the signal frequency. The resonant circuit has a very high 
input impedance, so it does not shunt the conductance inserted by 
the varactor in parallel'•with the resonant circuit, and equal to 


Gin—1/-Rin — (3cos Cq sin 0/2 (12.38) 

Referring to Fig. 12.2b, it is seen that the power dissipated in the 
load is now equal to 


P T = 


HGj 


2 (G l + G s + GJ 2 


(12.39) 


If G in < 0, then P' L > P L . From a comparison of Eqs. (12.37) and 
(12.39), the following expression can be written for the power gain 
factor 


/ G s + Gl \ 2 
\ Gl + G s + Gm / 


(12.40) 


As an example, for a parametric amplifier with Gl = 0.013 S, G s = 


When the stated condi¬ 
tions are satisfied, the 
parametric amplifier is 
said to operate in the 
synchronous mode 


A 

Solve Problem 8 
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= 0.01 S, and G[ n = — 0.02 S, the power gain factor is 
K P = 0.023 2 /0.003 2 = 58.78 


The condition for the 
self-excitation of the 
parametric amplifier 


or, on the decibel scale, 

A P =101og 10 Kp= 17.69 dB 

The stability of a parametric amplifier. Should the negative 
conductance of the varactor completely balance both the internal 
conductance of the signal source and the load conductance, the 
parametric amplifier will jump into self-excited oscillations. 
Equation (12.39) shows that this occurs at the critical value of the 
negative insertion conductance, defined by 

G in ,cr= -(Gs + Gl) (12.41) 


Assuming that the phase relations between the signal and the 
pump output are optimal in the sense that sin d> = — 1, then, from 
Eqs. (12.34) and (12.41), the critical degree of capacitance 
modulation is found to be 


2 (Gs+Gl) 
(D s C 0 


(12.42) 


Example 12.4. A single-stage parametric amplifier operates at 
6 GHz (X = 5 cm). The signal source and the load have the same 
conductance of 0.005 S ( R s = Rl = 200 Q). The capacitance of the 
varactor is C 0 = 0.8 pF. Find the limits of capacitance variation at 
which the circuit jumps into self-excited oscillation. 

From Eq. (12.42), we get 

o 2 x °- 01 

Pcr- 6.28 x 6 x 10 9 x 0.8 x 10" 12 “ 

Thus, the parametric amplifier will jump into self-excited 
oscillations if the capacitance of the varactor varies harmonically in 
time between the limits C max = C 0 (l + Per) = 1-328 pF and C m m = 
= C 0 (1 - Pcr) = 0.272 pF. 


Parametric amplification in the asynchronous condition. In 
practice, it is difficult, if at all possible, to satisfy the condition of 
synchronism, a> pU mp = 2co s , exactly. If the signal frequency is 
somewhat off the desired value, that is, if 

COs = G>pump/2 + 5co 

the parametric amplifier is said to operate iii the asynchronous 
mode. Now <F, which, in accord with Eq. (12.34), controls the value 
of the insertion resistance, is a function of time: 

O = 2 COs — tOpiimp 


Ch. 12 Signal Transformations in Linear Parametric Circuits 


361 


Varying as 


Rin — 


_ 2 __ 

(3c0s Gq sin (2co s — co P ump — 5co t) 


the insertion resistance changes sign periodically. In consequence, 
the output signal undergoes deep variations in level, similar to 
beats. This drawback of single-stage parametric amplifiers is 
a serious obstacle to their practical use. 

The double-stage parametric amplifier. Attempts to improve the 
performance of parametric amplifiers have resulted in 
fundamentally distinct parametric amplifier designs which are free 
from the above shortcomings. These are double-stage parametric 
amplifiers (up-converters and down-converters) which can operate 
with any phase relation between the signal and pump frequencies 
and irrespective of the initial phases of the two waves. This effect is 
achieved through the use of an auxiliary oscillation at one of the 
intermodulation frequencies. 

A circuit schematic diagram of a double-stage parametric 
amplifier is shown in Fig. 12.3. It is seen that the amplifier consists 
of two tuned circuits. One, called the signal tuned circuit , is tuned to 
co s ; the other, called the idling (or idler) circuit , is tuned to the idler 
frequency copier — co pump - co s - The two circuits are coupled by 
a varactor whose capacitance varies in time harmonically at the 
pump frequency co pU mp • 

C ( t ) = C 0 (1 + (3 COS COpump t) 

If v s (t) and tidier(0 are voltages across the signal circuit and the 
idler circuit, respectively* then the current through the varactor is 

d 

i(t)*C(t) — (v s -V idler) (12.43) 

Suppose that 

Vs ( t ) = V m ,s cos CDs t (12.44) 



The output signal of a 
parametric amplifier in 
the asynchronous con¬ 
dition 


• 

The idling (idler) cir¬ 
cuit and the idler fre¬ 
quency 


It is assumed that the 
modulation depth of 
the capacitance is suf¬ 
ficiently small 



Fig. 12.3 Double-stage parametric amplifier 
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The system acts as a 
current source 


The intermodulation components of the current flowing through 
the varactor include a component at the idler frequency 

Zidler (0 = Im ,idler COS (cooler t + T 7 ) (12.45) 


where / m ,idler and remain to be defined yet. 

Assuming that we know i^res,idler, the resonant resistance of the 
idler circuit, we may write 

y idler(0 = idler -^res, idler COS (©idler 1 + *F) (12.46) 

On substituting (12.44) and (12.46) in (12.43), we obtain the 
following expression for the current in the parametric capacitor: 

i (t) = C 0 (1 + (3 cos CGpump 0 [ (Os V m)S sin (O s t 

+ ©idler Im,idler-^res,idler Sin (©idler ^ + *F)] 

In order to derive iidler(0 from the above expression, we note 
that the component at ©idler = co pU mp - co s can be obtained only 
from the product 

COS ©pump t Sin ©s t = */ 2 [sin (©s ©pump) t 
+ sin (©s + ©pu m P )f] 

Thus, the current at the idler frequency does not depend on the 
voltage across the idler circuit, UidierM, and is equal to 

P©sC 0 Im,s . /n/l7 x 

*idler(0~ ^ sm ©idler t (12.47) 

Therefore, 


P©s C 0 F m>s I^ r es,idler . 

Midler (0 — “ Sin ©idler t 


Now let us find the current through the varactor at the signal fre¬ 
quency, i s (t). By analogy with the previous reasoning, we find that 
this current is independent of the voltage across the signal circuit, 
v s (t). Noting that 


— dialer P©s ©idler C 0 V m ,s I^res,idler 


d t 


COS ©idler t 


and 


1 


COS ©pump t COS (©pump ~(O s )t = — [COS © s t + COS (2© pU mp - ©s) t] 
we find that 

— P 2 © s ©idler Co Vm,s I^res,idler 


h(t) = - 


COS ©c t 


4 


(12.48) 
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Therefore, the conductance introduced in the signal circuit by the 
series combination of a varactor and the idler circuit is equal to 


is (0 P 2 ©s ©idler Cq -Rres,idler 

Vs ( t) 4 


(12.49) 


Since the insertion conductance is negative, the circuit is capable 
of amplifying the signal in power. The gain factor is found by Eq. 
(12.40). Stability analysis is carried out in the same way as for the 
single-stage parametric amplifier. 

If we compare Eqs. (12.38) and (12.49), we will above all see that 
in a double-stage parametric amplifier the negative insertion 
conductance is in no way related to the initial phases of the signal 
and the pump output. Also, the precise choice of ©s and ©pump is 
not critical. The insertion conductance will always be negative so 
long as ©pump -' > ©s • 

Power balance in multistage parametric amplifiers. The 
insensitivity of a double-stage parametric amplifier towards the 
phase relation between the signal and the pump output makes it 
possible to analyse such systems on the basis of simple power 
relations. Let us turn to the general circuit diagram in Fig. 12.4. 

Here, three circuits are connected in parallel with a nonlinear 
capacitance C n i. One is the signal circuit, the second is the pump 
circuit, and the third is the idler circuit tuned to an intermodulation 
frequency 

©i = m © s + rnopump (m and n are integers) 

Each circuit includes a narrowband filter which transmits only fre¬ 
quencies close to © s , ©pump, and ©i, respectively. For simplicity, let 
the signal and pump circuits be free from ohmic losses. 

Let us omit for a moment the signal source or the pump. Then 
the current flowing through the nonlinear capacitor will not carry 
components at intermodulation frequencies. The current in the idler 


Advantages of a 
double-stage param¬ 
etric amplifier 


The reasoning equally 
applies if a system 
contains a nonlinear 
inductive element 


m 


Filter 


s pump 

COi 

rH 


Lj 


C nl 


Fig. 12.4 To the derivation of power relations for a two-stage parametric 
system 
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circuit will be zero, and the system as a whole will behave as 
a reactive network which draws no average power from the source. 

Now we let both the signal source and the pump be present in 
the circuit. In the circumstances, the current through the nonlinear 
capacitor includes a component at an intermodulation frequency; 
this current can complete its path only through the idler circuit. 
The load in the idler circuit draws an average power, and positive 
or negative resistances are inserted in the signal and pump circuits, 
the magnitude and sign of which govern the distribution of power 
between the signal source and the pump. 

This is a closed (self-contained) system and, on the basis of the 
law of conservation of energy, the average powers in the signal, the 
pump output, and the intermodulation frequency are connected by 
a relation of the form 

Ps + Ppump + Pi = o (12.50) 

The power averaged over period T may be expressed in terms of 
the energy E dissipated over this time interval as 

1 T 

P = —$v(t)i(t)dt=fE 
1 0 

where / is the frequency in Hz. Thus, 

fs E$ + /pump ^pump +/i E[ = 0 

or, recalling that / = m/ s + nf pump , 

fs {Ps + WlE\) + /pumpC^pump + nE[) = 0 (12.51) 

Equality (12.51) must be satisfied identically at any values of/ s and 
/pump- This can be so only if 

E s + mE[ = 0 (12.52) 

Epump + nEi = 0 

By replacing energies with powers, we obtain two important 
equations known as the Manley-Rowe relations : 


* 

The Manley-Rowe re¬ 
lations 


Ps/fs + 


mP[ 


m fs + ft/p ump 


= 0 


P pump If Dump + 


nPi 


mfs + ft/pump 


= 0 


(12.53) 


The Manley-Rowe relations give a simple and easy-to-grasp 
insight into power transformation by multistage parametric systems. 
Let us illustrate this with two typical cases. 
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Parametric up-conversion. On setting m = n = 1 in Eqs. (12.53), 
we obtain 

Ps/fs + Pi/(fs +/pump) = 0 

Pi 

Ppump/Zjpump + Pi/(fs +/pump) — 0 (12.54) ~ Ppump 

As is customary, let the power dissipated in the load be positive, 
and that supplied by the signal source, negative. From Eq. (12.54) it _ p 
is seen that since Pi > 0, then P s <0 and P pU mp < 0. Thus, if the 

idler circuit of the amplifier is tuned to a frequency / =/ s + /pump, _!- 

both the signal source and the pump will deliver power to the idler ^pump^i 

circuit where it is used up in the load. Since 

Pi = — Ps~ P pump 


the power gain factor is 

Kp = Pi/ — Ps = 1 +/pump//s =/i//s (12.55) 

An advantage of the parametric up-converter is the absolute 
stability of the system which will not jump into self-excited 
oscillation at any value of signal and pump power. A disadvantage 
of the circuit is that the output signal has a higher frequency than 
the input signal. At microwave frequencies, this brings about certain 
difficulties during the subsequent signal processing. 

Regenerative parametric amplification. Let m= — 1 and n= 1, 
which means that the idler (output) circuit is tuned to f\ = / pU mp — 

— f s . The Manley-Rowe relations now take the form 

Ps/fs — Pi/(fipump ~ fs) = 0 (12.56) 

It is assumed 

and / >/s 

^pump 

Epumpy/pump + Pi/ (/pump — fs) = 0 (12.57) 


As follows from Eq. (12.56) now both Pi and P s are positive. 
Thus, some of the power drawn from the pump is transferred to the 
signal circuit which is another way of saying that regeneration takes 
place in the system at the signal frequency. The output power may 
be taken off both the signal circuit and the idler circuit. 

Equations (12.56) and (12.57) do not make it possible to find the 
gain factor of the system, because P s contains both the part drawn 
from the devices connected to the amplifier input, and the part 
arising due to regeneration. It should be noted that such amplifiers 
are apt to jump into self-excited oscillation, because, given certain 
conditions, a non-zero power will be developed in the signal circuit 
even in the absence of the signal applied to the amplifier input from 
external circuits. 


that 


(O 

pump 



























366 


Part Two. Circuits 


12.4 Nonstationary Dynamic Systems 


Linear dynamic systems containing parametric elements are 
a more complicated form of linear parametric devices. Their models 
may be RC -, RL- or RCL -networks with circuit elements of the 
form R(t), C(t) or L(t). In the general case, such systems can be 
described mathematically, using linear differential equations with 
variable coefficients: 


a n ( t ) 


d i^out 
d t n 


d 71 " 1 t; ou t , 

+ a n _ 1 ( t ) -ri „ ~i - 1" 


dr 


n-i 


+ a 1 (t) + a 0 ( t ) r ou t =f(t) (12.58) 

General methods for an analytic solution of such equations, given 
an arbitrary dependence of the coefficients on time, are nonexistent. 
This is why a prominent role is played by approximate methods 
based on the specific behaviour of a particular system. This section 
will examine two nonstationary dynamic systems for one of which 
a rigorous solution can be obtained, whereas the other permits us 
to find with a relative ease the approximate characteristics of the 
output signal of importance to practical applications. 

Free oscillations in a parametric RC-network. Consider a source- 
free RC-network made up of a fixed resistor R and a parametric 
capacitor of capacitance C(t). Initially, the voltage across the 
capacitor is t>c(0)= V 0 . We set out to find the manner in which vc 
varies for t > 0. To write a differential equation for the system, we 
note that the current in the circuit is 


i(t)= Cdvc/dt+ vcdC/dt 



By Kirchhoffs second law, the initial-value problem may be 
stated as 


RC dvc/dt + (1 + R dC/dt) v c = 0 
vc(0)=V o 


(1259) 


Importantly, if the capacitance were fixed, the initial-value problem 
for the system in question would be stated as 


RC dvc/dt + vc = 0 
v c (0)=V o 


(1260) 


By comparing (1259) and (12.60), we note that in the general case 
the differential equation of a parametric system cannot be 
developed by simply inserting the variables R(t), C(t) or L(t) in the 
equation corresponding to a stationary system. 
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Consider the specific case of a linearly varying capacitance, when 
C(t)=C 0 + at 


dC/dt = a 


where C 0 and a are certain constants. 

The differential equation can readily be solved by separating the 
variables: 


d vc 
vc 


= d In vc = 


1 + aR 

--df 

R (C 0 + at) 


The quantity a has the 
dimensions of con¬ 
ductance 


Hence, 


In vc = 


1 + aR f d t 

R J C 0 + at 


1 + aR . 

-In (at + C 0 ) + 


In ,4 


or 

vc(t) = A(at + C 0 r {1+aR)laR ( 12 - 61 ) 

The constant A is readily found from the initial condition 
vc(0) = ACo {1+aRVaR =V o 

The final solution of the problem (12.59) has the form 
Vc (t)=V 0 (\+at/C 0 )- (l+aR)laR (12.62) 

It is useful to compare Eq. (12.62) with the solution for 
a stationary problem for d = 0: 

vc(t)= V 0 exp( - t/RC 0 ) (12.63) 

The plots constructed on the basis of Eqs. (12.62) and (12.63) 
appear in Fig. 12.5. The 4 *parameter a has been taken as \/R. In the 
circumstances, the capacitance of the capacitor increases by C 0 over 



Fig. 12.5 Variations in the voltage across the capacitor of a parametric 
RC-network during a source-free discharge. It also shows the curve related 
to a stationary circuit with a time constant x 0 = RC 0 
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the time interval x 0 = RC 0 which is the time constant of 
a stationary circuit. 

Interestingly, the voltage across the parametric system varies at 
a higher rate during the initial time interval, but later the 
exponential (12.63) falls off more rapidly than the power function 
(12.62). 

A tunable-capacitance resonant circuit. Quite a number of 
communication devices, such as spectrum analyzers or scanning 
receivers, make use of resonant circuits made up of an L and a C, 
v s one of which is made to vary in time by some means, thereby 
varying the resonant frequency of the tuned circuit. 

Consider a tunable resonant circuit under the following 
conditions: (1) The parametric element is a capacitor from which 
the output signal is picked off. (2) There are no losses in the 
resonant circuit. (3) The input signal is supplied by a source of 
harmonic voltage V{ n (t) = F m cosco 0 t. 

Recalling that the voltage across an inductor is given by 

d 

L di/dt = L-— (C dvc/dt + vc dC/dt) 
dt 

= LC d 2 veldt 2 + 2L(dC/dt)(dvc/dt) + L i;c(d 2 C/dt 2 ) 
we derive the following differential equation of the system: 
LCd 2 vc/dt 2 2L(dC/dt)(dvc/dt) (Ld 2 C/dt 2 + l)vc=v[ n (t) 

(12.64) 

If the capacitance varies linearly in time as C(t) = at, then Eq. 
(12.64) can b^ simplified as 

aLTd 2 v c /dt 2 +2aLdv c /dt+v c = F m cosco 0 t (12.65) 

The linear differential equation thus obtained has two 
distinctions. 

(1) The coefficient of the highest derivative is a linear function of 
time. 

(2) Although, under the assumption made, the circuit is free from 
ohmic losses, the left-hand side contains a term proportional to the 
first derivative of the sought function. Recalling that the analogous 
equation for a stationary resonant circuit has the form 

LC d 2 vc/dt 2 + RC dvc/dt + vc = V m cosco 0 t (12.66) 

we conclude that parametric variation in the capacitance of the 
resonant circuit is equivalent to the insertion of an amount of 
attenuation. 

Generally speaking, Eq. (12.65) must be supplemented with initial 
conditions defining vc and dvc/dt for t = 0. The total solution (see 
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Chap. 8) is the sum of a particular integral and the complementary 
function. The particular integral represents the forced (steady-state) 
response of the system, and the complementary function its free 
(transient) response. We will limit ourselves to seeking the forced 
response as being of the greatest practical interest. 

Suppose that in the sense to be defined shortly the capacitance 
C(t) varies slowly. This permits us to speak of the instantaneous 
resonant frequency 

cores (0= l/j/LC(r)= \j\fHlt (12.67) 

At time t 0 , when co res (£ 0 ) = > the system is at resonance, and 

the amplitude of the output wave is a maximum. At t < t 0 and t > 
> t 0 , the output signal has a lower amplitude. 

Since we are interested in the behaviour of the system in the 
vicinity of the resonant point t 0 , let us replace approximately the 
coefficient aLt on the left-hand side of Eq. (12.65) with a constant 


V S 


0 




t 


aLt 0 = I/cOq (12.68) 

Now the problem reduces to finding the partial solution of the 
differential equation 


d 2 vc/dt 2 + 2aU£>\ dv c /dt + co f 2 v c = co 2 V m cos co 0 t (12.69) 

We will seek the solution in the form 

vc(t) = A cos (o 0 t + Rsin co 0 £ (12.70) 

with unknown constants A and B. 

On substituting (12.70) in (12.69) and equating the coefficients of 
the sine and the cosine on* both sides, we get 

A = 0, B = V m /2aL(o 0 


Since the capacitance 
is assumed to vary 
slowly, the problem re¬ 
duces to solving a 
differential equation 
with constant coeffi¬ 
cients 


Thus, over a short time interval which includes the instant when 
the system passes through resonance, the voltage across the 
capacitor is 

v c {t) X (V m /2aLa> 0 ) sin co 0 t (12.71) 

The condition for the “slow” passage of a system through 
resonance. The accuracy with which Eq. (12.71) represents the 
actual process improves as the value of a is decreased. The 
constraints imposed on the value of a may be stated in more 
rigorous terms if we take advantage of the following physical 

consideration: The passage of a parametric system through In many cases of 
resonance should be regarded as slow, if over the period T = 2k/(Oq practical interest the 
the instantaneous resonant frequency co res (t) = 1/J /LC{t) changes by condition of slow pas- 
a substantially smaller amount than co 0 . sage is satisfied 
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The change in the resonant frequency is 
Acores = Acores/d t\ t= t 0 • T= - aLu>\Tf2 = - uTiLcog (12.72) 

The condition will be satisfied if 
anLcol « co 0 
Hence, 

a « 1/tcco 0 L = l/itpo (12.73) 

where p 0 is the characteristic impedance of the resonant circuit 
tuned to resonate at frequency co 0 . 

Example 12.5. The characteristic impedance of a resonant circuit is 
p 0 = 500 Q. The tuned-circuit capacitor changes in value at the rate 

a= 10" 4 S = 10^ 4 Fs" 1 = 100pF ps" 1 

Investigate the passage of the system through resonance. 

Taking advantage of the inequality (12.73), we see that the 
condition for the slow change of the capacitance is satisfied. On the 
basis of (12.71), we find that at resonance the amplitude of the out¬ 
put voltage is ten times the amplitude of the input signal 

l/2uLco 0 = l/2ap 0 = 10 


The impulse response and the frequency response of 
a nonstationary dynamic system. Any linear system, be it stationary 
or nonstationary (parametric), obeys the principle of superposition, 
and so it may be investigated by recourse to the Duhamel 
superposition integral. 

The impulse response of a parametric system, h(t , tfj is defined as 
the response to the delta-impulse applied to the input at time t x . 
Whereas for a stationary system the argument of the impulse 
response is solely the difference, t — t x , between the instant of 
observation and the instant when the excitation is applied, for 
a nonstationary system this relation may take an arbitrary form. 
Still, a physical system cannot give an output in advance of the 
input signal, so for a physically realizable system we always have 
that 

hit, t x ) = 0 for t<t 1 (12.74) 

If we know the impulse response h(t , tf), we can readily define 
the output signal of a nonstationary dynamic system as 

00 



U 


L 


Variations in the shape 
of the impulse respon¬ 
se of a parametric 
network with time 


(12.75) 
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The Fourier transform of the impulse response in terms of the 
variable is called the frequency response of a parametric network: 


00 

K(j«>, £) = j h(t, t 1 )exp( —j(of 1 )dt 1 (12.76) 

— 00 


If SinM is the spectrum of the input signal, then Eq. (12.75) in 
frequency representation takes the form 

i?out(t) = -J— I S in(co) K (/co, t) exp (/cot) dec (12.77) 

271 


A distinction of the frequency response (12.76) from the similar A distinction of the 
function characterizing a stationary system consists in that it has an f re q uen cy response of 
additional argument the observation time t. ^ parametric network 

Actually, Eq. (12.75) or (12.77) is a formal solution because the 
evaluation of the impulse response h(t , tf) or, which is the same, of 
the frequency response K(jco, t) involves an analysis of an exact 
model of the system, that is, solving the corresponding differential 
equation. Yet, this device is frequently employed when a complex 
real network has to be replaced with a maximally simplified 
mathematical model. For example, a parametric system may have 
the frequency response 


X(/co, t) = z(t) (12.78) 

which is independent of frequency. The corresponding device 
operates as a multiplier or an amplitude modulator. When it is 
driven by an input wave of the form 


l?in(*)= loCOSCOot 


its output signal is an AM wave 

»out (0 = V 0 z (t) cos co 0 t (12.79) 

Another important example is a nonstationary system operating 
as a frequency or phase modulator. Here 

K (/co, t) = exp \jz ( t)~\ (12.80) 


The simplifications as¬ 
sumed in describing 
nonstationary dynamic 
systems 


and so, under the conditions defined above, the output signal 


OoutW = V 0 cos [co 0 t + z(f)] 


(12.81) 


is an angle-modulated wave. 
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In most real cases the 
signal is both ampli¬ 
tude and phase modu¬ 
lated at random 


12.5 Response of Parametric Systems with Random 
Characteristics to Harmonic Signals 

It is of great interest, both theoretically and in the applied sense, 
to investigate the response of a system whose parameters vary in 
time at random. In the simplest case, this may be a random 
instability in the frequency response function of a device, leading to 
fluctuations in the amplitude at the output. In a more complicated 
situation, one may be concerned with the propagation of signals in 
various media, say, in the Earth’s ionosphere subject to variations 
in the refractive index. Here the received signal is corrupted by 
a random angle modulation because the shift of the signal phase 
along the propagation path is a random time function. 

A detailed investigation of the statistical characteristics of the 
signals at the output of linear systems with randomly varying 
parameters is an extremely complex task [14, 15]. In this section, 
we will only dwell in brief on two of the simplest problems of the 
kind. 

Random amplitude modulation. In investigating a parametric 
system whose frequency response has the form defined in (12.78), we 
assume to know the mean m z and the autocorrelation function 
K z ( x) of the stationary random process Z(t) which defines the form 
of modulation. 

By resort to correlation theory, we will investigate the statistical 
characteristics of the process Y(t) at the output of a system, 
assuming that the input signal is a harmonic wave, V 0 cos co 0 t. Since 
the realization of the output signal is 

y(t) = V 0 z(t) cos (o 0 t 

it follows that m y = y = 0. 

The autocorrelation function of the output signal is 
K y (x) = y(t)y(t + x) = V 2 0 z(t)z(t + x) cos co 0 t • cos co 0 (t + x) 

(12.82) 

Since 


cos co Q t cos co 0 (t + x) = l/2[cos co 0 (2t + x) + cos co 0 x] = 1/2 cos co 0 x 
then 

Kyi*) = (V%/2)z(t)z(t + x)cosco 0 x 
By definition, the mean product is 
z ( t) z (t + x) = K z (x) + m 2 

Hence, the final relation connecting the autocorrelation function of 
the output signal and the random frequency response z ( t ) takes the 
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form 

KyCO = ( V o/2) [K Z (X) + mf] cos o 0 t (12.83) 

and the variance of the output random process is 
a 2 = (F 2 /2)(a 2 + m 2 ) 

The form of Eq. (12.83) is an indication that if the realizations 
z(t) vary more slowly than the input signal, the output wave is 
a narrowband random process. It is to be noted that if m z ^ 0, then 
Ky(x) does not tend to zero for x->oo. 

To get insight into the physical significance of the above 
property, let us take the inverse Fourier transform of K^x), that is, 
find the power spectrum of the process Y(t): 


W y (<») = J K y (x) exp ( —jot) dx 

oo 

j Rz(x)cosco 0 xcoscoxdx 


T/2 2 oo 

V o°Z 


V 2 m 2 00 

, y 0 m z r , 

H--— J cosco 0 xdx 

^ — 00 

By simple rearrangement, we can re-write the above equation as 
F 2 g? 00 

Wy (CO) = y-^-[ J J? z (T)cOS(C0 0 + ffl)TdT 

^ — 00 

00 

+ J R-(t) cos (<b 0 0)) xdx] 

— 00 

V 2 0 m 2 z n 


+ 


- [5 (co + co 0 ) + 6 (co - co 0 )] 


(12.84) 


Equation (12.84) tells us that the power spectrum of the process 
at the output of a random amplitude modulator contains two 
components: a continuous part due to random fluctuations in the 
amplitude, and a discrete part which represents the response of the 
system to the unmodulated carrier wave; the spectrum of the 
discrete part corresponds to two delta-functions in the frequency 
domain. The contribution of the discrete part increases as ml 
becomes progressively greater than a 2 . In approximate form, the 
autocorrelation function and the power spectrum for the case in 
question are plotted in Fig. 12.6. As is seen, the continuous part of 
the spectrum is represented by two smooth curves with maxima at 
points co = ± co 0 . 

The envelope of the output signal. If Z(t) is a slow process, it is 


The power spectrum of 
a signal in the case 
of random amplitude 
modulation 


The envelope 
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Envelope 



0 


The variance of the 
signal remains con¬ 
stant in the case of 
random angle modula¬ 
tion 




Fig. 12.6 Characteristics of the signal at the output of a random amplitude 
modulator: (a) autocorrelation function; ( b ) power spectrum 


legitimate to think that the instantaneous value of the physical 
envelope at the output of the system is 

V y (t)=\V 0 z(t)\ (12.85) 

The modulus sign indicates that the amplitude detector producing 
this envelope at its output is insensitive to the phase of the high-fre¬ 
quency carrier. 

As is seen from (12.85), the envelope of the narrowband process 
at the output of a parametric system with a fluctuating frequency 
response z{t) may be obtained as a result of a nonlinear lag-free 
(zero-memory) transformation of the random process z(t) in an 
imaginary device with a piecewise-linear characteristic i> ou t=| v 0 Vm\- 
The mean, the variance, and the autocorrelation function of the 
envelope can be calculated by the techniques set forth in Chap. 11. 

Random angle modulation. Now let us turn to a random 
parametric system whose frequency response has the form defined 
in (12.80). Going through the steps taken in our investigation of 
a random amplitude modulator, we can develop a general 
expression for the autocorrelation function of the output signal 
when the system is driven by a harmonic excitation: 

KyW= V^cos [oV + z(£)] cos [a> 0 (r + t) + z(t + t)] 

= (Vl/2) {cos [2 gV + ® 0 x + z(t) + z(t + t)] 

+ cos [co 0 T + z(t + x) - z(t)]} (12.86) 

On averaging, the first term in the braces will obviously vanish, and 
so 

Ky(x) = (Vq/2) cos (co 0 t + z t - z) 

= (V1/2) cos (z x - z) cos cg 0 t — (V1/2) sin (z T - z) sin od 0 t (12.87) 


(To simplify the expression, we have omitted the argument of the 
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function z(t).) 

If x-*0, then 

lim cos (z T — z) = 1 

and 

lim sin (z T -z) = 0 

so that the effective power in the signal, that is, its variance Oy = 
= Vq/2 is the same as the power in the harmonic signal of 
amplitude V 0 and at a constant frequency. 

Equation (12.87) gives a complete description of a signal 
subjected to random angle modulation in terms of correlation 
theory. Among other things, it tells us that if the process Z(t ) is 
formed by realizations which are slow in comparison with 
harmonic waves at frequency co 0 , then the output signal of 
a random phase modulator is a narrowband process with a centre 
frequency co 0 . 

Angle modulation by a normal random process. In order to 
make use of Eq. (12.87), we should find the mean of its 
trigonometric functions with a difference argument. This can be 
done on the basis of a bivariate probability density function p(z x , 
z): 

00 

cos(z T -z) = JJcos(z T -z)p(z T , z)dz x dz 


sin (z T — z) = f J sin (z T -z)p(z t , z)dz T dz 

— 00 

It may prove difficult to evaluate such integrals if the function 
p(z T , z) is arbitrary. If, however, Z(t) is a Gaussian process, an 
elegant technique suggests itself, immediately leading to the final 
result. It is based on the use of a bivariate characteristic function 
for a Gaussian process (see Eq. (6.32)): 

© (v x , v 2 ) = exp \j (z x v x + zv 2 )~\ 

= exp [jm z (v 1 + v 2 ) - —<3 2 z (v* + 2R z (x) v x v 2 + v\)~\ 

( 12 . 88 ) 

Since 

/ N exp [j (z x - z)] + exp [ - j (z x - z)] 
cos (z x -z) = - - - 

then, by virtue of Eq. (12.88), 

cos(z T -z) = y[0(l, —!) + ©( —1, 1)] 


Averaging with the aid 
of the characteristic 
function 


(12.89) 







































376 


Part Two. Circuits 


On putting for definiteness m z = 0, we have 
0(1, -1)=©(-1, 1) = exp{ — erf [1 — /?z(t)]} 

Therefore, 

cos (z T - z) = exp {- ct| [1 - ^z(t)]} 
sin (z T — z) = 0 

Substituting the above results in (12.87) yields the final expression 
for the autocorrelation function of the signal produced from 
a harmonic wave by Gaussian angle modulation: 

vi 

K y ( T ) = ~ 2 “ ex P {- [1 - Rz (x)]} cos (o 0 t (l2.90) 


Qualitatively, the above function is analogous to that found 
earlier in the analysis of random amplitude modulation. Therefore, 
the conclusion that the power spectrum contains two components’ 
continuous and discrete, may fully be carried over to the present 
case. Analysis [15] shows that for of» 1 random angular 
modulation is broadband. The discrete part of the spectrum 
practically disappears, whereas the continuous part in the vicinity 
of frequency co 0 is described by a Gaussian function of the form 


Wy(a)= V\]/njl 


1 

CTzj/ — R'z(0) 


exp 


- (to - co 0 ) 2 

2ct 2 [ — R'z(0)] 


The effective bandwidth 


(12.91) 


AtOeff=j/2^CT z l/-f?''(0) 


(12.92) 


increases with an increase in both a z and - R' z (0) proportional to 
the time rate of change of the modulating function. 


Summary 

<X> If the impedance of a lag-free (zero-memory) parametric element periodically varies in 
time, the spectrum of the output signal contains, generally speaking, an infinite 
number of intermodulation products at sum and difference frequencies of the form 
co s + /co)c {k = 0, ± 1, ±2, ...). 

00 A resistive parametric element can be implemented by applying the sum of a small 
message signal and a large control signal to the input of a lag-free nonlinear one-port. 

vV Frequency conversion consists in translating the signal spectrum from the neighbour¬ 
hood of the carrier frequency into the neighbourhood of the intermediate frequency 
without any change in the form of modulation. 
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In synchronous detection, the signal frequency is the same as the local oscillator 
frequency. 

Reactive parametric elements can transfer some of the pump power to the circuits 
containing the useful signal. 

0^ Given appropriate phase relations, a parametrically controlled capacitor can initiate 
oscillations in an LC resonant circuit. Connection of such a capacitor is equivalent to 
the insertion of a negative conductance in the resonant circuit. 

Parametric amplifiers may be single-stage and double-stage. In the latter case, 
a parametric amplifier includes an idler circuit tuned to one of the intermodulation 
frequencies. 

00 Power relations in a multistage parametric system are described by the Manley-Rowe 
relations. 

0*0* Parametric dynamic systems are described by differential equations with variable 
coefficients. 

00 The frequency response of a linear parametric system is a function of both frequency 
and time. 

00 In the case of random amplitude modulation the spectrum of the output signal 
contains both a continuous and a discrete component. 

00 If, in the case of angle modulation, the modulating function is a realization of 
a normal random process, the autocorrelation function of the output signal may 
be stated in terms of the characteristic function of the signal at the modulator 
input. 


Review Questions 

1. What is the fundamental difference between the spectra of the currents flowing in 
a resistive parametric one-port and a nonlinear one-port? Assume that both elements 
are driven by a harmonic excitation. 

2. Draw up a block diagram of a superhet receiver. What is the image frequency in 
reception? How can the ambiguity in receiver tuning be resolved? 

3. Define the conversion transconductance. 

4. List the merits and demerits of a synchronous detector. 

5. Is it possible to excite a tuned circuit with the aid of a parametric capacitor whose 
capacitance varies in time at a frequency equal to the resonant frequency of the tuned 
circuit? 

6. Describe the physical principle underlying the operation of the varactor. 

7. Name the phenomena accompanying the operation of a single-stage parametric amplifier 
in the asynchronous mode. 

8. What is the advantage of double-stage parametric amplifiers? 

9. Why is it that parametric amplifiers have a low level of internal noise? 

10. Formulate the condition for the “slow” passage of a parametric tuned circuit through 
resonance. 

11. Give an example of a physical system in which the input signal is subjected to random 
amplitude modulation. 

12. List the salient features of the signal spectrum produced by random angle modulation of 
a harmonic carrier. 
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Problems 

1. The parametric conductance is varying 
in time as 

G(t)=10 -3 + 5 x 10“ 4 cos 10 5 t + 3 x 
x 10" 4 x cos2 x 10 5 t 

The excitation is a voltage 
v(t) = 5 cos 10 6 t 

Find the amplitudes and frequencies of all 
the current components. Plot the spectral 
diagram. 

2. A lag-free nonlinear resistor has the 
current-voltage characteristic (mA) 

i(v) = 5 + 2.5v + \.5v 2 

The voltage (V) applied to the resistor is 
v(t) = 3 + 0.5 cos Clt 

Derive the equation defining the time 
dependence of the dynamic trans¬ 
conductance. 

3. There is a frequency converter built 
around a transistor whose characteristic is 
given by 

20(i;be — 0.5) for i;be > 0.5 V 
0 for i;be < 0.5V 

In the “no-signal” condition, the base is fed 
with the sum of the bias voltage and the 
local-oscillator voltage (V): 

vbe = 0.2 + 0.7 cos coi 0 t 

Find the conversion transconductance. 

4. The capacitance of a parametric 
capacitor (pF) varies in time as 

C (t) = 200 + 80 cos (10 5 1 + ti/ 4) + 40 cos 5 
x 10 5 t 

The voltage applied to the capacitor (V) is 
v= 30cos5 x \0 6 t 

Find an analytic expression for the current 
in the capacitor. 

5. The inductance of a tuned circuit is 
0.5 mH, the average capacitance is C 0 = 


= 750 pF, the tuned-circuit loss resistance is 
12 Cl. The tuned-circuit capacitance varies 
stepwise by the same amount in either 
direction from the mean value. Find the fre¬ 
quency at which the tuned-circuit 
capacitance should be varied and between 
what limits for the resultant Q of the tuned 
circuit to be Q = 300. 

6. Find the Q-factor of a tuned circuit 
whose inductance is 100 pH and whose loss 
resistance is 15 £1 The tuned-circuit capa¬ 
citance (pF) is varied in time as 

C(t)= 150 + 5cos 1.63 x 10 7 t 

7. The capacitance (pF) of a parametric 
capacitor connected in a tuned circuit is 
varied in time as 

C(r) = 300 + 20cos5 x 10 6 t 

Find the inductance and the Q-factor at 
which the system will be excited 
parametrically and the amplitude of 
oscillation will build up without bound. Is 
the solution thus found the only one? 

8. A single-stage parametric amplifier has 
been built to amplify at a frequency of 120 
MHz. The amplifier contains an inductor of 
0.6 pH; the tuned-circuit Q-factor is 35. 
Find the frequency at which the tuned- 
circuit capacitor should be varied and 
between what limits for the gain of the 
system to be 15 dB. 


Advanced Problems 

9. Derive the expression defining time 
variations in the free response of 
a parametric i^C-network whose capacitance 
varies in time as 

C ( t ) = C 0 + C m cos co c t 

where oo c is the frequency of the control 
signal. 
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10. Find the impulse response of 
a parametric jRC-network whose capacitance 
varies in time as 

C (t) = c 0 + C m exp (- t/x) a (t) 

where C 0 , C m , and t are constants. 


11. A source of d.c. voltage V 0 is 
connected at time t = 0 to a series 
jRC-network for which R(t) = R 0 exp(at) and 
C (t) = C 0 exp (- at). Derive equations 
defining variations in vr and vc- Analyse 
the cases for a » 1/-R 0 Q> an d a ~ V-^oQ- 





















Chapter 13 

A Basic Theory 
of Linear Circuit Synthesis 


Circuit theory may be divided into two broad areas closely 
related to each other, namely analysis and synthesis. The objective 
of analysis is to find the external characteristics of a system whose 
structure is specified in advance by giving its schematic diagram. 
■ The objective of synthesis is diametrically opposite. We are given 

Circuit synthesis yields an external characteristic, say, the frequency response function, and 

more than one result we are to find the circuit structure implementing the given 

characteristic. 

In contrast to analysis, circuit synthesis will usually yield more 
than one result. Therefore, it is additionally required to find, from 
among the several structures possessing the same specified 
properties, that which is optimal in a particular sense. The criteria 
of optimality may be many and diverse. For one thing, it is always 
desired that the circuit being synthesized should contain the least 
possible count of circuit components. In other cases, it may be 
desired that the circuit be sensitive only slightly to the choice of 
element values. 

13.1 Analytical Properties of the Driving-Point Impedance 
of a Passive Linear One-Port 

Recently, circuit synthesis methods have come to play an 
especially important role with the advent of computer-aided circuit 
design systems. A whole range of synthesis procedures, sometimes 
extremely sophisticated, have been developed, with which the reader 
may acquaint himself on his own [27, 30]. This Chapter will be 
concerned with two very simple problems of synthesis, namely the 
structures of linear one-ports and two-ports made up of elements 
such as R, L, and C. In all cases, the basic data for the synthesis 
will be stated in terms of frequency characteristics. 

It is to be noted that the synthesis procedures set forth here can 
be applied not only to electric or electronic circuits, but also to any 
linear systems which can be modelled as circuits. 

For a network synthesis procedure to be informative, we should 
above all establish the criteria that could be used to predict the 
realizability of a network. This section will be concerned with the 
most important properties of the driving-point impedance of 
passive linear one-ports. 

Location of poles and zeros. Let V(p) and I(p) be the Laplace 
transforms of the voltage across and the current in a one-port. 
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Their ratio 
Z(p)=V(p)/I(p) 

is the driving-point impedance defined over the entire complex-fre¬ 
quency plane. Also, as can be recalled from Chap. 8, 

amP m + am-iP m ~ 1 + ••• + a 1 P + a 0 
Z(p) b n p n +b n _ 1 p n -' + ...+b 1 p+b 0 

_ Z 0 (p- zjjp- z 2 )...(p- z m ) 

( P-Pi)(p-P2)-‘(P-Pn) 


The poles p l9 p 2 , Pn and the zeroes z l9 z 2 , z m of the 
driving-point impedance of a one-port should be such that the 
system in question which, by the statement of the problem, does 
not contain any sources continuously feeding energy, will be stable. 

Let the terminals of the one-port be open (the open-circuit or 
no-load condition) and a voltage exist between them. Since no 
current is flowing through the one-port, the behaviour of the 
one-port can be described by the characteristic equation 

I (p)/V(p) = 1/Z (p) = 0 (13.2) 

whose roots are the poles of the driving-point impedance Z (p). Any 
voltage between the terminals of a one-port which is in the 
open-circuit condition and is storing an amount of energy in its 
reactive elements is described by 

VoAt) = A j exp (pi t) + A 2 exp (p 2 t) + ... + A n exp (p n t) 

where the s are the coefficients found from the initial conditions. 
The condition for an open-circuited system to be stable is defined 
by the inequality 


Re(/?i) < 0, i = 1, 2, ..., n (13.3) 


Similarly, if we examine the same one-port with its terminals 
short-circuited (the short-circuit condition), when V(p) = 0, but 
I (p) ^ 0, a second characteristic equation can be derived 

V(p)/I(p) = Z(p) = 0 (13.4) 

Its roots are the zeros of the driving-point impedance; they should 
be such that 


Here Z 0 is an arbitra¬ 
ry scale factor 


$ 

The characteristic equ¬ 
ation of a one-port 


Re(zf) < 0, i = 1, 2, ..., m 


(13.5) 
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Location of the poles 
and zeros of a stable 
one-port 



Pi 


The positive real (p.r.) 
function 


Thus, both the poles and the zeros of the driving-point 
impedance of an absolutely stable passive linear one-port lie solelv 
in the left-hand half of the complex p-plane. Also, the roots are 
always either real or form complex-conjugate pairs. 

The limiting idealized case is a purely reactive one-port. Since it 
is free from ohmic losses, its poles and zeros are always located on 
the imaginary yco-axis. 

The number of poles and zeros. Further information about the 
behaviour of the function Z(p) is given by the following important 
theorem: The number of poles for the driving-point impedance of 
a passive one-port cannot differ from that of zeros by more than one 
By way of proof, let us write the driving-point impedance at 
some physical frequency co as 

Z(/co) = | Z(/co) | exp(/argZ) ^3 ^ 

_S° that % (13.6) can be depicted graphically, we should put p = 
-;co m Eq. (13.1) and draw vectors from all poles and zeros so that 
their tips converge to the selected point on the imaginary axis 
representing the current frequency. Then, as can readily be seen, the 
phase angle of the driving-point impedance is 

m n 

ar 8 z = X <p z k- £ <p p i 
k= 1 1=1 

which means that the poles decrease, and the zeros increase the 
resultant phase. 

On the average, a stable passive one-port always draws power 
rom external sources at any frequency. This implies that the real 
part of the driving-point impedance, Z(/co), is positive. Hence, 

— it/2 < arg Z ^ ti/2 

Let the frequency co tend to infinity. Then both the phases of the 
poles and the phases of the zeros will tend towards n/2. Thus, 
lim arg Z = (m — n)n/2 m J 

Therefore, the numbers m and n may be either the same or differ bv 
unity. J 

In circuit theory, the function Z(p), analytic in the right-half 
plane and having a nonnegative real part on the imaginary /co-axis 
belongs to a special class of positive real (p. r.) functions. 

More tangibly the above theorem may be stated like this: As the 
frequency tends to infinity, any passive network can behave either 
as a resistor, if the degree of the numerator in Eq. (13.1) is the same 
as that of the denominator, or as a capacitor, if the degree of the 
denominator is greater by one than that of the numerator, or, 
finally, as an inductor if the converse is true 


T 


Ch. 13 A Basic Theory of Linear Circuit Synthesis 


383 


Relation between the real and imaginary parts of the 
driving-point impedance. It is an easy matter to verify that at real 
frequencies to the driving-point impedance of a one-port made up of 
a resistor R and an inductor L connected in parallel is defined by 

co 2 RL 2 (oLR 2 

Z{j(0 ) = R (/CO) +jX (/CO) = R2 + 0 f L 2 +J R 2 + a 2-JY 

It is to be noted that the values of R and L enter both the real and 
the imaginary part of the driving-point impedance. 

Networks composed so that each of their elements affects both 
the real and the imaginary part of Z(/co) are usually called 
minimum-impedance networks. For this class of networks, there is 
a unique relation between R (/co) and X (/co) for real values of 
frequency. 

Let us fix the frequency co and investigate the integral 



Minimum-impedance 

networks 


() z lPL d p = 0 03.9) 

J p-/co 


taken over a closed contour in the right half-plane. The pole arising 
for p = /co is passed around along the semi-circle C { of small radius. 
The integral along the infinitely large arc C 2 is negligible because 
Z(p) is analytic to the right of the imaginary axis. Therefore, 


T Z (£) d ^ , f Z(p)dp _ 0 (13.10) 

5“© Ci p-i© 

The integrand Z(p)/(p-/co) in the vicinity of the pole p=/co tends 
to infinity uniformly. Therefore by Cauchy’s residue theorem, 
noting that arc C 1 is a half-circle and the residue at the pole is 
Z(/co), we may re-write Eq. (13.10) as 


J Z — d — + jnZ (/co) = 0 (13-11) 

-00 5-® 

Hence, on splitting into the real and imaginary parts, we get 


*(/©) = — J 

^ — on 


£-co 


(13.12) 


1 00 

K (/co) = — J 

^ -00 


co-^ 


Thus, the real and imaginary parts of the driving-point 
impedance for the class of one-ports in question are related by 
a Hilbert pair. 



Only half the residue 
at a pole contributes 
to the integral 


Here the integrals are 
taken in the sense of 
the principal value 
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Example 13.1. There is a parallel RC-network for which 


R (/co) = 

R 

(13.13) 

l + co 2 (KC) 2 

and 



X(ja) = 

- co R 2 C 

(13.14) 

1 + co 2 (RC) 2 


Verify that, if the real part of the driving-point impedance for this 
network is known, we can recover the imaginary part by means of 
Hilbert transformation. 

On setting a=l /RC and inserting (13.13) into (13.12), we get 

X(j(o) = — l _ J -^_ , n 

nRC* 4 (a 2 + ^)(^-(B) ( 13 ’ 15 ) 

The integrand can be expanded into partial fractions: 

1 a^ + b c 

(a 2 + £ 2 )(£ -(n) a 2 + 'if + £ - © 


where 


a = — 


1 


b = 


to 


a 2 + cb 2 


c = — a 


a 2 + to 2 

The individual integrals have the form 


I 


a 2 + if 


-=o, J 


dlj 


§-co 


= 0 . I 


d^ 


-00 a 2 + 


-= Jt/a 


On substituting them in (13.15), we obtain Eq. (13.14), which was to 
be proved. 



0 —?- 
( ill — 

0—i- 


▲ 

Solve Problem 1 


The result thus obtained is very important in assessing the 
behaviour of the driving-point impedance of a one-port along the 
entire frequency axis. As an example, we may quote a theorem 1“36] 
which establishes that the driving-point impedance of any network, 
such as an amplifier, whose driving-point capacitance is C-J 
satisfies the inequality 
00 

f R indco ^ (tc/2 )/ C i n (13.16) 

On this ground we may state, for example, that an amplifier with 
a flat driving-point impedance R in = 1 MQ over the frequency 
mterval 0-1 MHz, with the input capacitance being Q n = 10 pF is 
unrealizable in principle. 

The driving-point impedance of reactive one-ports. The frequency 
properties of the driving-point impedance of purely reactive 
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Fig. 13.1 Typical plots of functions X{jo) for two purely reactive networks 


one-ports are concern of Foster's theorem [27], an important 
proposition in circuit theory. It is stated as follows: If Z(/co) = 
=jX (/co), then the reactive impedance is a nondecreasing function, 
that is, dX/dto > 0. The frequency dependence of the driving-point 
impedance for some reactive one-ports is plotted in Fig. 13.1. 

As a corollary to the Foster theorem, we may state that (a) points 
p = 0 and p = oo are the singularities (zeros or poles) of the 
driving-point impedance; (b) on the jco-axis, the poles and zeros 
alternate. 

In synthesizing an electric network, it is mandatory first to 
analyse the function Z(p) for its properties so as to discard the 
obviously unrealizable characteristics. 


Foster’s theorem 


The properties of the 
driving-point impedan¬ 
ces of reactive one- 
ports 

▲ 

Work Problem 2 



Z 2Y 



Example 13.2. We are given the function 


P(P 2 + 1) 

P 2j r 


(13.17) 


which has three zeros : z 1 =0, z 2 = j and z 3 = — j ; and two poles : 
p 1 = 2 j and p 2 = - 2 j. 

The singularities are located on the imaginary axis (which is 
typical of reactive networks). The number of poles is by one smaller 
than the number of zeros. Nevertheless the network described by 
the function in (13.17) cannot be realized because it violates the 
requirement that the singularities should alternate on the ;co-axis. 


13.2 Synthesis of Passive One-Ports 

The classical problem of one-port synthesis can be stated as 
follows: We are given the driving-point immitance of the desired 
network, which may be its driving-point impedance Z(p) or its 
driving-point admittance Y(p ), that meets all the requirements 
placing it among the functions of physically realizable and stable • 
one-ports. We are to synthesize the network answering the specified The problem of one- 
driving-point immitance. port synthesis 


13-728 
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Ladder networks 


The initial specification does not tell us anything about the struc¬ 
ture of the desired network. Therefore, we should guess some struc¬ 
ture in advance. The synthesis procedure does not yield a unique 
result: it may well so happen that one and the same driving-point 
immitance may be realized in more than one way. If so, preference 
is given to the design which is optimal in some sense, for example, 
one having the lowest count of circuit elements. 

The rationale of network synthesis. Any method of one-port 
synthesis is based on the fact that the specified driving-point 
immitance, Z(p) or Y(p), is subjected to a series of consecutive 
simplifications. At each step, we single out a particular expression 
which can be uniquely identified with a particular circuit element. 
The nature of these transformations is fixed in advance by the 
network structure we have chosen. The simplest structures we are 
going to consider are shown in Fig. 13.2. 



Fig. 13.2 Some of the one-ports being synthesized 

It is an easy matter to see that in case (a) 

Z(p) = Zi + Z 2 + ... + Z n (13.18) 

and in case ( b ) 

y(p)=y 1 + y 2 + ... + y„ (13.19) 

The one-ports shown in Fig. 13.2c and d are known as ladder 
networks. Here, for case (c) 


In practical synthesis 
problems, the number 
of structure elements 
is always finite 


Z(p) = Z 1 +- 




Z 2 + 


1 



(13.20) 
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and for case (d) 


Yip) = Yi + 


Zi + 


y 2 + ... 


(13.21) 


The expressions in (13.20) and (13.21) are called continued fraction 
expansions. 

By identifying the components Z 1? Z 2 , ..., Z n and Y l9 Y 2 , ..., Y n 
with specific physical elements we solve the task of one-port 
synthesis. 

Synthesis of reactive one-ports. We will dwell upon the basic 
techniques used in the synthesis of linear passive one-ports, taking 
as an example purely reactive networks made up of Land C. For 
this case, it is rigorously shown [27] that any realizable 
driving-point immitance, Zip) or Y(p), may be represented as the 
driving-point immitance of the networks shown in Fig. 13.2. The 
reactive one-ports shown in (a) and (b) are known as Foster type 
networks, and those in (c) and (d), are called Cauer ladder networks. 
Let us turn to a concrete example. 


Continued fraction ex¬ 
pansion 


Foster and Cauer net¬ 
works 


5<J> 


Im p 


1 $ 
—se 

-1 Q 
- 2 « 


Re p 


- 5 ? 


Example 13.3. The driving-point immitance is given as 


Z(p) = 


(p 2 + l)(p 2 + 25) p 4 + 26p 2 + 25 


P(P 2 + 4) 


p 3 +4p 


(13.22) 


Synthesize a network having the above driving-point impedance by the 
Foster (or partial fraction expansion) method. 

The direct division of the numerator into the denominator in 
(13.22) identifies the first network element: 


Z{p) = p + 


22 p 2 + 25 
p 3 + 4 p 


= p + Z\p) 


which is an inductance of 1 H. (Here and elsewhere the network 
element values are chosen to make the calculations easy to follow.) 

The function Z\p) can be simplified by expanding it into partial 
fractions: 


Z\p) = 


25 63p/4 

4p + p 2 + 4 


25 

¥ 


+ Z"ip) 


The first term on the right-hand side represents a capacitor of 
4/25 = 0.16 F capacitance. 

In order to identify the last network element associated with 


13* 
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Z"(p\ it is advantageous to change to the driving-point admittance 


7"(p)=l/Z"(p) = 


p 2 + 4 4 16 

“63p/4~ _ 6J P+ 63 p 


which represents a parallel combination of a capacitor of 4/63 
F capacitance and an inductor of 63/16 H inductance. 

The final step is to draw up a schematic diagram which 
implements the specified driving-point impedance: 


▲ 

Solve Problem 3 



4/63 

0 - 


63/16 


In order to synthesize a reactive one-port by the Cauer (or 
continued-fraction expansion) method, the specified driving-point 
immitance should be expanded into a continued fraction series. The 
procedure leading to this form stems from the very structure of the 
fraction. It is called the “divide and invert the remainder ” process. 


Example 13.4. Synthesize a network having the driving-point 
impedance defined in (13.22) by the Cauer (continued-fraction 
expansion) method. 

We divide the numerator into the denominator, beginning with 
the highest degree: 

4 , ^ 2 , \P 3 + 4p 

p* + 26/r + 25 - 

p (13.23) 

p A + 4 p 2 
22p 2 + 25 


The quotient is the first network element which, as in the Foster 
type network, is a series inductance of 1 H. 

On writing 


Z(p) = p + 


_ 

p 3 + 4p 


(13.24) 


22 p 2 + 25 

we see that in (13.23) the denominator must be divided into the 
remainder - this is the inversion of the remainder. From this step 
on, division and inversion alternate: 


Divide : 

p 3 + 4p |22p 2 + 25 
25 p 


V + 


22 22 


63 p 
22 


Invert the remainder 
63 p 


22 p 2 + 25 

22 p 2 


22 


25“ 184p 

63 


▲ 

Work Problem 4 
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Divide 

_63p_|_25 
22 63 p 

550 


Combining the results, we can write the continued fraction 
expansion for Z(p) as 


Z(p) = p + 


1 


22 + 484 I 

~W P + w 

550 


1 


(13.25) 


which can be identified with the following Cauer ladder network: 




484/63 

1/224= 4= 63/550 


The two previous examples demonstrate that one-port synthesis 
does not yield a unique result. In fact, we can synthesize one more 
network having the sam£ driving-point impedance by the Cauer 
(continued-fraction expansion) method, if we begin division with the 
lowest, rather than the highest degrees of the polynomials. 


Example 13.5. Synthesize a network whose driving-point impedance 
is defined by (13.22), using the Cauer (continued-fraction expansion) 
method and beginning division with the lowest degrees of the 
polynomials. 

On writing 


Z(p) = 


25 -b 26p 2 + p 4 
4 p + p 3 


dividing and inverting the remainder, we get 


z W-f + ~J£ 


79p 


+ - 


1 


6241 79p 

252 p 63 


(13.26) 
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The above continued-fraction expansion gives us a reactive 
one-port arranged as shown below: 


0 - 


4/25 l 252/6241 
79/16; 


0 - 


79/63 


The Cauer method involving division and inversion of the 
remainder is convenient for computer-aided network synthesis. It 
permits a large number of variant techniques. For example, having 
begun the division with the highest degrees, we may reverse the 
order of powers during the subsequent steps. 


Canonic networks 


Darlington’s theorem 


Concluding remarks. Networks giving the minimum number of 
elements for a specified driving-point immitance are sometimes 
known as canonic networks. With reference to reactive one-ports it 
has been proved [27] that both the Foster and the Cauer forms 
possess this property. If N is the number of pairs of singularities 
(poles and zeros) of the driving-point immitance, other than zero 
or infinity, a canonic network contains N +1 reactive ele¬ 
ments. 

In practical synthesis it should be remembered that the expansion 
of Z(p) or Y(p) into a sum of partial fractions or continued 
fractions may produce negative coefficients. This implies that the 
adopted procedure leads to a nonrealizable network and that 
a different technique should be used. In the Cauer method, for 
example, it may prove advisable to begin division with the lowest 
rather than the highest degrees. It may so happen that in 
synthesizing an RLC -network of the general form none of the 
methods presented here can yield an acceptable result. This implies 
that the driving-point immitance involved cannot be realized in any 
of the proposed simple structures and recourse must be had to 
more complex forms such as described in [27]. What we may only 
say is that the desired network does exist, because, as follows from 
Darlington's theorem (of fundamental significance to circuit theory) 
[28], any physically allowable driving-point function can be 
realized as the driving-point impedance or admittance of some 
purely reactive passive four-terminal (two-port) network loaded into 
a single resistor. 

The search for suitable structures is the most crucial step in 
network synthesis. It commands special attention when developing 
an algorithm for computer-aided network synthesis. 
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13.3 Frequency Characteristics of Two-Ports 


A four-terminal (or two-port) network may be visualized as 
a black box with two pairs of accessible terminals (two ports), one 
pair (or port) being its input, and the other pair (or port) its output. 
In operation, the input port is connected to a signal source, and the 
output port is connected to a load impedance Zl. 

It is presumed that the reader has a previous knowledge of 
two-port analysis methods as they are explained in a course on 
circuit theory. This section will be concerned only with some points 
essential to two-port synthesis. 

Matrix notation. A very important property of a linear stationary 
two-port is that the four complex amplitudes V x , I 1 , V 2 an d i 2 are 
connected by two linear algebraic equations at any frequency of the 
excitation. If we choose any two of them as independent variables, 
the remaining two will be defined in their terms. This provides 
a basis for the matrix description of linear two-ports [25]. For 
example, one frequently uses the transmission (transfer or ABCD) 
matrix, taking the output voltage and the output current as the 
independent variables. Then, 

V 1 = AV 2 + Bi 2 

(13.27) 

i 1 = cv 2 + Di 2 

The coefficients A , B , C, and D have different physical dimensions 
and can be determined from open-circuit and short-circuit tests. 
Transmission matrices are especially convenient in describing 
a cascade connection of two-ports, because the resultant matrix is 
the product of the individual matrices. 

If the matrix of a two-port and its load impedance are known in 
advance, we can find the so-called network functions such as 

(a) the driving-point impedance Z- m = Vji l ; 

(b) the transfer impedance Z t = V 2 /I 1 ; 

(c) the voltage-ratio transfer, or frequency response, function 

KO)=W. 

In the general case, the network functions are frequency- 
dependent and characterize the frequency properties of two-ports in 
a variety of problems. Any network function can be expressed in 
terms of the members of the two-port’s transmission matrix and in 
terms of the load impedance. Thus, by dividing the respective sides 
of Eqs. (13.27), we find that 


' i 



Zl 


Network functions 


Z in = (AZ L +B)/(CZ h + D) 


(13.28) 


Similarly, the voltage-ratio transfer function is found to be 
K(jco) = VJVi = Z L /(AZ L +B) (13.29) 
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It is to be noted that K(jod) depends on the direction in which 
power is transferred in the network. If we interchange the source 
and the load, we should write the voltage-ratio transfer function for 
the reverse direction as 

K rev (/®) = V x /V 2 | Z L on the left (13.30) 


In the general case, the forward and reverse voltage-ratio transfer 
functions are not the same. 

The transfer function of a two-port. In our further discussion, the 
argument of the transfer function will be not only the variable ;co, 
but also the complex frequency p. In other words, we shall use both 
K(jcd) and K(p\ the latter being the more general form of the 
transfer function. The transfer function of a two-port has all the 
properties of the same functions of linear stationary systems 
examined in Chap. 8. For example, the transfer function of a linear 
constant-parameter two-port has the form 


K (p) = K 0 


(p-z 1 )(p-z 2 )...(p-z m ) 

(P-Pl)(p-P 2 )--(P-Prd 


(13.31) 


Location of the poles 
of the transfer function 
of a two-port 


When the transfer 
function has a zero at 
infinity, the amplitude 
response shows a high 
rate of roll-off at high 
frequencies 


9 

Minimum-phase net¬ 
works 


where K 0 is a constant. If the network is stable, then the poles p x , 
p 2 , Pn must be located in the left half-plane, occurring as 
complex-conjugate pairs. 

Usually, an additional condition is introduced: The number of 
poles of K ( p ) must be greater than that of zeros , which means that at 
infinity the transfer function must have a zero rather than a pole. In 
consequence, the impulse response of the network 


1 00 1 
h(t) = j K (/a>) exp (j&t) dec = — r 


2nj 


J K (p)exp(pfjdp 

c 


must be bounded, because with an infinitely large radius of the 
integration contour C the exponential term of the integrand would 
“cancel” the integral around the arc. 

In contrast to what we have for the driving-point impedance of 
a one-port, the difference in number between the poles and zeros of 
the transfer function may be any. This is because no energy 
constraint may be imposed on the phase response. 

Location of the zeros of the transfer function. In contrast to the 
poles, the zeros of K(p) for a stable linear two-port may be located 
in both the left and right half of the complex p-plane. This is 
because the characteristic equation K(p) = 0 signifies that, given 
some V x (p) # 0, the Laplace transform of the output voltage, V 2 (p), 
vanishes. This does not run counter to the assumption that the 
system is stable. 

Two-port networks which have no zeros in the right half-plane 
are called minimum-phase networks. If they do have zeros in the 
right half-plane, they are called nonminimum-phase networks. 


T 


Ch. 13 A Basic Theory of Linear Circuit Synthesis 


393 


The above names owe their origin to the following. Let there be 
a complex plane with points z 1 and z 2 in the left and the right half¬ 
plane. We also let these points be the zeros of the transfer function 
of a two-port. If the two-port is driven by a harmonic excitation 
such that p = ;cd, then the two points correspond to two phasors on 
the complex plane, namely: V 1 = jco - z 1 and V 2 = ;co - z 2 , 
corresponding to the respective factors in the numerator of Eq. 
(13.31). The two phasors rotate and vary in length with changes in 
the frequency co, but they do so differently. The difference is that, as 
the frequency varies from - oo to + oo, the phasor V x increases the 
phase angle of the voltage-ratio transfer function by n radians, 
whereas the phasor V 2 decreases the phase by the same amount. The 
voltage-ratio transfer function of a two-port is a rational function 
whose argument varies as 



AargX(/co) 


CO = + 00 
CO = — 00 


= A arg (numer.) — A arg (denomin.) 


Therefore, given the same number of zeros and poles, a non¬ 
minimum-phase network will show a larger change in the phase of 
the transfer function than a minimum-phase network. 

The location of zeros for K(p) is related to the topological struc¬ 
ture of the network. It is shown in circuit theory that any two-port 
will be a minimum-phase network if it has the property such that 
the transmission of the signal from input to output can be 
completely discontinued by breaking only one branch. Notably, any 
ladder-type two-ports are minimum-phase networks. 

As a rule, nonminimum-phase networks are bridge and lattice 
networks in which the signal can reach the output over two and 
more paths. The simplest example of a nonminimum-phase network 
is a balanced lattice network formed by R and C. Here, as can be 
readily seen, 

K(p) = (pRC - 1 )/{pRC + 1) (13.32) 

This transfer function has a zero at point p= 1/RC, that is, in the 
right half-plane. 

However, the bridge or lattice structure does not automatically 
guarantee that the network is a minimum-phase one, so it is 
essential to verify the presence or otherwise of zeros in the right 
half-plane in each particular case. 

Relation between the magnitude and phase responses of 
a two-port. It is proved [1] that minimum-phase two-ports have 
a remarkable property: Their magnitude and phase responses are 
uniquely related to each other. The real and imaginary parts of the 
logarithm of the frequency response function 

In {| K (/co) | exp [/'cpK(co)]} = In | K (/co) | +/(px(co) = \|/k(co) +/cpx(co) 
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form a Hilbert transform pair 


1 00 

<Pk( ©) = — 1 

^ — 00 


5“® 


'|/k(®) = — 1 

tt -on 


cpjcfe)d^ 

co-^ 


(13.33) 



Uses of nonminimum- 
phase networks 


The frequency de¬ 
pendence of the power 
transfer function 


A minimum-phase two-port realizing a specified magnitude 
response cannot have just any phase response. Basing ourselves on 
the properties of the Hilbert transforms (see Chap. 5), we may 
argue, for example, that if the magnitude response of a minimum- 
phase two-port is a maximum at some particular frequency, its 
phase response will cross zero in the vicinity of that frequency. 

If, on the other hand, a two-port belongs to the nonminimum- 
phase class, its magnitude and phase responses are independent of 
each other. Among the nonminimum-phase networks, the most 
important role is played by all-pass two-port networks whose 
magnitude response is constant and independent of frequency. An 
example is a balanced lattice RC two-port for which (see (13.32)) 

| K (/go) | = 1, c \>K= — 2 arc tan oxRC (13.34) 

Such two-ports are used for the phase compensation of signals. 
They are able to make up in part for the distortion of signals 
passing through a circuit. 

The power transfer function. As will be recalled (see Chap. 8), 
this term refers to the square of the magnitude response of 
a two-port: 

K p(co) = K (/co) K* (/©) = K (/©) K (- /©) (13.35) 

In contrast to K(jm), the power transfer function Kp{(o) is real. 
Because of this it is especially convenient to state the initial 
specifications needed to synthesize a two-port in its terms. Unfor¬ 
tunately, it does not tell us anything about the phase response of 
the system. 

As is seen from (13.35), the power transfer function is an even 
function of frequency, so it can always be represented as the ratio 
of two polynomials in powers of co 2 : 

K P ((o) = M (© 2 )/N (co 2 ) (13-36) 

By a change of variable p = j©, the power transfer function 
K P (a ) is continued analytically from the imaginary/©-axis over the 
entire complex frequency plane: 

K P (p) = K(p)K(-p) (13-37) 


Equation (13.37) establishes a very important fact: If a+jb is 
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a singularity (a zero or a pole) of the function K(p), then Kp(p) will 
likewise have a singularity for both p = a+jb and for p = - a —jb. 
It is customary to say that the singularities of the power transfer 
function show quadrant symmetry, that is, they are located in the 
complex plane so that their centre of symmetry is at the origin. 
This property is of special value for two-port synthesis, as it permits 
one to recover the frequency response function from a known 
Kp{p). 


13.4 Low-Pass Filters 

This section will be concerned with the frequency behaviour of 
low-pass filters whose function is to transmit with a minimal 
attenuation all frequencies from zero up to a desired cut-off fre¬ 
quency, co c , and to attenuate all higher frequencies (from co c to 
infinity). 

Steps in filter synthesis. As a rule, the first step in the synthesis of 
frequency-selective networks is to formulate the requirements for 
their frequency response. For example in the case of a low-pass 
filter with a cut-off frequency oo c the ideal magnitude response has 
the form 


\K(jco)\ = 


1, 0 ^ CO ^ CO c 

0 , co > co c 


(13.38) 


(physical frequencies, co > 0, are meant). No constraints are imposed 
on the phase response. This approach is known as the synthesis of 
a filter from the specified magnitude response. 

It is known in advance that the ideal magnitude response defined 
in (13.38) is not physically realizable (see Chap. 8 ). Therefore, the 
second step of filter synthesis is to approximate the ideal 
characteristic with a function which may belong to a physically 
realizable network. 

The final step is to realize the selected characteristic and to 
develop a circuit diagram complete with all the necessary element 
values. 

The two forms of approximation most frequently used in 
practical filter design are the maximally flat (or Butterworth ) 
approximation and the equal-ripple (or Chebyshev ) approximation. 

The maximally flat approximation. This form of approximation is 
based on the use of the power transfer function 


K P ((o N ) = 1/(1 + © 2 ") (13.39) 


where con = co/co c is a dimensionless normalized frequency. 
Low-pass filters having such a characteristic are said to have 


ju 



Location of poles with 
quadrant symmetry 


The cut-off frequency 
of a filter 


\K\ 

1 - 

__tu 

0 w c 


In the general case, 
the power transfer 
function may contain 
an arbitrary scale fac¬ 
tor 
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a maximally flat or Butterworth response, and the filters themselves 
are called maximally flat or Butterworth filters. The integer n — 1, 2, 
3, ... controls the closeness of approximation and is called the order 
of a filter. From comparison of (13.36) and (13.39) it can be seen 
that a Butterworth filter is realizable for any value of n. Within the 

The order of filt P ass banthat is ’ for the square of the magnitude 

e or er o a i er response asymptotically decreases with increasing frequency. At the 

cut-off frequency (for co N = 1) the asymptotic slope produced by the 
filter is 101og 10 0.5 ~ — 3 dB, irrespective of the filter’s order. The 
greater the value of n, the closer the approximation. The maximally 
flat response curves for two values of n, constructed on the basis of 
Eq. (13.39), appear in Fig. 13.3. 

A 

Solve Problem 5 Kp 



Fig. 13.3 Frequency dependence of the power transfer function of n = 1 
and n = 5 Butterworth filters 

The parameter n is chosen according to the degree of attenuation 
that should be given to signals at frequencies co > co c . 

Example 13.6. Find the parameter n for a Butterworth filter with 
a cut-off frequency of 10 5 s “ \ whose attenuation at co = 3 x 10 5 s “ * 1 
would be at least — 26 dB relative to the level at co = 0. 

From the statement of the problem, we conclude that the 
parameter n must be the nearest integer (with an excess) to the 
solution of the equation 

101 °gio j _j_ ^ 2 n = ~26 
or 

1 + 3 2n = 10 2 - 6 = 398 
On solving it, we get 

2 n = log 10 397/log 10 3 = 5.45 
Hence, n = 3. 
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When the signal is appreciably distant from the pass band, then 
con » 1, and from Eq. (13.39) we have 

Kp(® n) ~ ^N 2 ” 

A 

Work Problem 6 

Hence, the asymptotic slope (attenuation) on the decibel scale is 


A = 101og 10 iCp^ — 20n log 10 co N 

An octave is the in¬ 

This implies that each time the frequency is doubled, the 
attenuation produced by a Butterworth filter is increased by 
— 20 n x 0.301 » — 6n dB. That is, the magnitude response falls 
asymptotically at a rate of 6n dB/octave outside the pass band. 

The transfer function of a maximally flat (Butterworth) filter. In 
order to be able to synthesize the filter, we should change from the 
power transfer function as defined in (13.39) to the transfer function 
K(p ). To this end, we introduce the normalized complex frequency 
PN=tfN+;o)N and re-write (13.39) as 

terval between two 
points having a basic 
frequency ratio of two 

Kp(Pn) - K(p N )K( p N )= 2n (13.40) 

1 + ( ~ 1) Pn 


Hence it is seen that in the /?N-plane the function Kp(p^) 
answering a Butterworth low-pass filter of the nth order has In 
poles which are the roots of the equation 



1 + (- 1)>n =0 (13.41) 


All of these roots are located on the unit circle with centre at the 
origin. For n = 1, the coefficients of the power transfer function are 
found from the equation 

Pn = 1 


that is 

jPNi = 1, PN 2 = - 1 (13.42) 

For n = 2, the equation 

Pn= -1 

has four roots: 

PN, = Pn 2 = Pn 3 = Pn 4 = (13.43) 

▲ 

Solve Problem 7 

Finally, for a third-order (n = 3) Butterworth filter, the equation is 
Pn = 1 
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n =1 n=2 n=3 


Fig. 13.4 The poles of the power transfer function for a Butterworth 
low-pass filter with n = 1, 2, 3 


which has six roots: 

(13.44) 


The location of the roots in the complex plane for the cases listed 
above is shown in Fig. 13.4. 

The general trend for any value of n is this: All poles are spaced 
apart the same angular distance equal to n/n; if n is an odd 
number, the first root is pni = 1; if n is even, then p N i = exp(/7i/n). 

Now we will take advantage of the fact that the poles of the 
power transfer function show quadrant symmetry, that is, their 
number and location in the two half-planes are the same. Hence, we 
may rightfully conclude that only the poles located in the left half¬ 
plane answer the filter being synthesized. Their “mirror images” in 
the right half-plane are associated with the function K(-p) and are 
ignored. 

The principle described above is the pivotal one in filter 
synthesis, because the subsequent realization of the network is 
based on it. _ 

Example 13.7. Find the transfer function of an n = 2 Butterworth 
low-pass filter. 

The transfer function has two poles in the left half-plane (see 
Eq. (13.43)): 

Pn 2 = ( - 1 +M 1/7 Pn 3 = ( - 1 -JV 1/2 
Hence 

K ( V k) =_!-=-- (13.45) 

(Pn - Pn 2 )(Pn - Pn 3 ) + 1 / 2 p N + 1 

Thus, an n = 2 Butterworth filter can be implemented with 
a second-order dynamic system (an oscillatory element). 


* 

f 


V 


Im p N 


\ 




J 


The selection of poles 
of the transfer function 
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Chebyshev approximation. Also known as the equal-ripple 
approximation, this technique is likewise widely used. For the 
resultant form of filter, the power transfer function is defined as 


Kp(con) = 


1 

1 + 8 2 C^(C0n) 


(13.46) 


where s < 1 is a constant number called the ripple factor in the pass 
band, and C n ( con) is the nth-order Chebyshev polynomial* defined 
by 

C n (x) = cos (narc cos x) (13.47) 


The ripple factor 


Higher-order Chebyshev polynomials are obtained through the 
recursive (or recursion) formula 

Cn(x) = 2xC n _ 1 (x) - C„_ 2 (x) (13.48) 

such that C 0 (x) = l and C 1 (x) = x. 

Chebyshev polynomials are frequently used in all kinds of 
approximation problems owing to the following property: Among 
any polynomials of degree n with the same coefficients of the high¬ 
est power of the argument, these polynomials deviate least of all 
from zero in the interval - 1 < x < 1. On the other hand, Cheby¬ 
shev polynomials sharply increase in magnitude at |x|»l. 
Asymptotically, 

Cnipc) « 2 n ~ 1 x n for | x | » 1 (13.49) 

Such functions are convenient to use in the ideal low-pass filter 
approximation. As is seenjfom (13.46), within the pass band Kp 
oscillates about unity such that the maximum value is 1 and the 
minimum is 1/(1 + 8 2 ). Outside the pass band, that is, at oon» 1, 
the filter attenuates the signal appreciably. 




A typical plot of a 
Chebyshev polynomial 


The property of Che¬ 
byshev polynomials 


Fig. 13.5 Frequency dependence of the power transfer function of a Cheby¬ 
shev low-pass filter 


* An alternative symbol for Chebyshev polynomials is T n ( oo) from the 
older transliteration “Tschebishev”.- Translator’s note. 
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▲ 

Solve Problem 8 


Typical plots of the power transfer functions for n = 2 and n = 3 
Chebyshev filters appear in Fig. 13.5. As is seen, within the pass 
band the frequency characteristics of the filters are nonmonotonic. 
The ripple in the attenuation increases with the value of 8. As 
follows from (13.46), an increase in e leads to a greater attenuation 
of the signal outside the pass band. By matching two variables, 
n and e, it is possible to satisfy the initial specifications for the filter 
being synthesized. 


Example 13.8. There is an n = 3 Chebyshev filter which, at the 
cutoff frequency (con= 1), attenuates the signal in power by half that 
is, by the same amount as a Butterworth filter. Find the attenuation 
produced by this filter at a frequency three times the cutoff frequency. 

To begin with, let us find 8. As follows from (13.47), C n ( 1) = 1 for 
any n , so Kp( 1) = 1/2 if 8=1. 

The 3rd-order Chebyshev polynomial is 

C , 3(® n ) = 4 «>n-3© n 

Hence, the attenuation produced by this Chebyshev filter with 
a ripple factor of unity at frequency oo = 3co c will be 

Acheb = 10log 10 1 + = - 39.91 dB 

It is interesting to note that under similar conditions an n = 3 
Butterworth filter will produce an attenuation equal to 

Anut = 101og 10 1 + = - 28.36 dB 

Thus, a Chebyshev filter appreciably improves the performance of 
a frequency-selective system. 


The transfer function of a Chebyshev low-pass filter. As is seen 
from (13.46), the poles of the power transfer function of a Cheby¬ 
shev filter are the roots of the equation 

1 + 8 2 C^(/?n) = 0 (13.50) 

(compare with Eq. (13.41)). 

The solution of the above equation is somewhat involved, and 
will not be given here. The interested reader is referred to [28]. 
Instead, we will simply give the results of such a derivation. First 
we introduce a design parameter 



The next step is to find the poles of a Butterworth filter with the 


Ch. 13 A Basic Theory of Linear Circuit Synthesis 


401 


same value of n. Then we can change to the poles of the Chebyshev 
filter by multiplying the abscissa of each pole of the Butterworth 
filter by sinha, and the ordinate by cosh a. 

Whereas the poles of a Butterworth filter are located on the unit 
circle, those of a Chebyshev filter are located on an ellipse which, 
on the p N = ctn + ;co n plane, is specified by 

(GN/sinh a) 2 + (cdn/cosIi a) 2 = 1 

Once the coordinates of the poles are obtained, we can write the 
transfer function of the Chebyshev filter as 

K ^ “ (p N - PNi) (PN - PN 2 )- • -(PN - PNrc) 


Example 13.9. Find the transfer function of an n = 2 Chebyshev 
filter with 8 = 1. 

Here 

a = 2 in (1 +1/2) = 0.4407 

The corresponding Butterworth filter has two poles: 

PNi = 0.707 ( - 1 +;) and p N2 = 0.707 ( - 1 -j) 

Hence, the abscissae of the Chebyshev filter are — 0.707 sinh a = 
= — 0.322, and the ordinates are ± 0.707 cosh a = ± 0.777. 

It is seen from the above example that in going from a maximally 
flat to a Chebyshev response, the poles move towards the imaginary 
axis, whereas their vertical displacement is insignificant. Physically 
tTiis signifies that the oscillatory system making up the Chebyshev 
filter will produce a smaller attenuation. 


A 

Work Problem 9 



The poles of the 
Butterworth and the 
Chebyshev filters 


13.5 Implementation of Filters 

The final step in the synthesis of a filter is to find its circuit 
arrangement. In this section we will consider what is known as 
structural synthesis in which a circuit is formed by a cascade 
connection of a number of sections or stages separated from one 9 
another by ideal isolation networks (Fig. 13.6). The voltage-ratio Structural synthesis 
transfer (frequency response) function of such a device is given by 

K (/co) = Ki (/co) K 2 (/co). . .KnO'co) 

The individual functions K l9 K 2 , ..., K N must be such that they 
realize the poles of the transfer function K (p\ defined earlier during 
the approximation step. 
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The use of isolation 
networks is widely 
practised in present- 
day microelectronic 
active circuit synthesis 



input Isolation networks Output 

Fig. 13.6 Filter formed by a cascaded connection of elements (the isolation 
networks are usually emitter followers) 


J^CUh 

R 


o 


It takes two kinds of networks to build a low-pass filter, namely 
a lst-order network which has only one real pole, and 
a second-order network which has a pair of complex conjugate 
poles. 

The lst-order network. The simplest example of this kind is an 
L-section RC two-port for which 

K(p) = l/(l + pRQ (13.52) 

the coordinate of the pole being p x = - 1 /RC. 

It is to be noted that by specifying p l9 we only obtain the 
product RC. One of these two elements, R or C, may be chosen at 
will. For example, it may be desired that the capacitance C be 
substantially greater than the input capacitance of the succeeding 
stage. This will make the filter less sensitive towards inaccuracies in 
the selection of the element values. 

The 2nd-order network. Two complex conjugate poles of the fre¬ 
quency response function can be realized with the aid of the 
L-section two-port shown schematically in Fig. 13.7. 


▲ 

Work Problem 10 


j<*> 



Fig. 13.7 A 2nd-order element: (a) schematic diagram; (b) location of the 
poles of the transfer function 


It is an easy matter to find that for this type 

Kin)- “0 

P> p 2 + 2ap + n 2 0 

where 

co 0 = 1/j/Ec and a =1/2 RC 


(13.53) 
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The poles of the transfer function are 
p lj2 = — a+il/o^-a 2 (13.54) 

which may be complex conjugate or real, depending on the relative 
magnitude of co 0 and a. 

Let us consider several examples of a low-pass filter implemented 
with cascade-connected networks. _ 

Example 13.10. Realize an n = 3 Butterworth filter with a cut-off 
frequency of 10 5 s -1 . The filter is loaded into a resistor Rl = 

= 0.5 m 

As has been shown, the transfer function of such a filter has three 
poles located as follows: 

p 12 = 10 5 (cos60° ± j sin 60°) 

= - 0.5 x 10 5 ± y'0.866 x 10 5 s " 1 



▲ 

Work Problem 11 


p 3 = - 10 5 s 1 


Here, we have changed from the normalized complex variable pn to 
the true complex frequency p = co c PN- 

Accordingly, the sought-for filter may be visualized as a cascade 
connection of a lst-order stage corresponding to the pole p 3 , an 
isolation network, and a 2nd-order stage for which the poles are p 1 


lst-order 



2nd-order 

network 



network 


In accordance with (13.52), the lst-order stage must have a time 
constant RC = l/co c = 10 " 5 s. If we choose C = 10 nF, then the 
resistor used in this stage will be R = 10 5 /C= 1 kQ. 

^Let the resistor used in the 2nd-order stage be the load resistor. 
On the basis of (13.54), the pair of complex conjugate roots will 
have the desired real part if 

1/2R L C= - Re p lj2 = 0.5 x 10 5 


Hence, 

C=1/10 6 R l = 0.02 pF 


Finally, the inductance is 
L= 1/cdcC = 5 mH 

The schematic diagram of the synthesized filter has the form 



0 1 
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Example 13.11. Realize an n — 2 Chebyshev low-pass filter 
operating into a resistive load , R^=l kfL The initial specifications 
for the synthesis are: cut-off frequency , co c =10 5 s -1 ; ripple factor, 

8=1. A 

In order to realize the second-order frequency response, it will Solve Problem 12 
suffice to have one L- section JRLC-network. In Example 13.9 we 
have obtained the coordinates of the poles of the transfer function 
for an n = 2 Chebyshev filter with s = 1: 

PNi f2 = -0.322+7 0.777 

or, on changing back to the non-normalized variable p, 

Pi ,2 = (~ 0.322 ±j 0.777) x 10 5 s“ 1 

The capacitance of the capacitor C can be found from (13.54) on 
equating a to the required abscissa of the poles: 

u= 1/2R l C = 0.322 x 10 5 
Hence, 

C= 15.53 nF 

The inductance L is found from the equation for the coordinates 
of the poles on the imaginary axis: 

]/cOq - a 2 = 0.777 x 10 5 

On solving it, we get 

= l/LC = 0.708 x 10 10 


A 

Solve Problem 13 


L— 1/cOoC = 9.09 mH 

Thus, the specified response characteristic is realized by the 
following circuit 


— - 0 - . 

9.09 mH 

! 4= f1 ikn 

- 15.53 nF U 

0--0-1 


It is to be noted that in practice, especially at microwave fre¬ 
quencies, use is made of filters in which there are no isolation 
networks. The reader may acquaint himself with the techniques 
used for the synthesis of such circuits in [29]. 

Implementation of high-pass filters. The function of a high-pass 
filter is to pass waves whose frequencies exceed the cut-off fre¬ 
quency, co c , with as little attenuation as practicable. 

A high-pass filter can be generated directly from a normalized 
low-pass filter having the same cut-off frequency through a techni¬ 
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que known in circuit theory as frequency transformation. The gist of 
the technique is as follows. 

To begin with, we change from the variable p used in the 
synthesis of low-pass filters to a new frequency variable p' such that 

p-W (13 - 55) 

Then the point p = 0 will map into a point at infinity in the 
p'-plane, and the two points p lt2 = ±7’co c on the imaginary axis will 
map into two points p' 1>2 = + j®c, the latter differing from the 
former only in sign. Therefore, we may expect that the magnitude 
response of the high-pass filter generated from a low-pass filter by 
frequency transformation defined in (13.55) will be that of a high- 
pass filter. 

Now each capacitor which has admittance pC in the low-pass 
filter must be replaced with an element whose admittance is co o 2 C/p\ 
that is, with an inductor of inductance L= 1/cocC. Similarly, the 
inductor Lin the low-pass filter must be replaced with a capacitor, 
C=l/cOcL. The resistive elements are left unchanged. The 
transformation just described is illustrated in Fig. 13.8. 



0 - 


1 /(o>| L,)| 


l/(u )lL 2 ) 

)i/Wc) 


0 - 


- 0 - 


Fig. 13.8 Transformation of a low-pass filter into a high-pass 


filter 


Implementation of band-pass filters. A band-pass filter passes 
with a small attenuation only the frequencies in the interval 
adjacent to some point 0. If there is a normalized low-pass 
filter with the specified cut-off frequency, we can go over to 
a band-pass filter directly by a change of the variable 

p = p' + G>o/p' (13.56) 

Now the point p = 0 will map into a point p'=j® 0 , so that the 
peak of the magnitude response observed at zero frequency in the 
low-pass filter will occur at frequency co 0 i* 1 the band-pass filter. 
Since 


pC = p'C + 


co pC 
P' 


the admittance of the capacitor used in the low-pass filter must be 
replaced in the band-pass filter with the admittance of a parallel 
resonant circuit made up of a capacitor C and an inductor of 
inductance L= 1/co \C. It is to be noted that this resonant circuit is 
tuned to frequency co 0 . 


Frequency transforma¬ 
tion ought not to be 
confused with the fre¬ 
quency conversion ef¬ 
fected by nonlinear and 
parametric networks 


Frequency transforma¬ 
tion entails some dis¬ 
tortion in the ampli¬ 
tude response of the 
filter being synthesiz¬ 
ed, but it is of mi¬ 
nor importance for a 
narrowband filter 
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Similarly from the equality 
pL= p'L+ ®lL/p' 

we conclude that the inductor L is to be changed into a series 
combination of the same inductor and a capacitor C = l/co^L, 
which is recognized as a series resonant circuit tuned to frequency 
co 0 (Fig. 13.9). 




Fig. 13.9 Transformation from a low-pass filter into a band-pass filter 

From the examples examined above it follows that in the 
• synthesis of frequency-selective networks the low-pass filter serves 

The prototype filter as the prototype filter whose parameters make it possible to 
generate subsequently any other form of filter. 


Summary 

<0*0 The poles and zeros of the driving-point (input) impedance of a stable linear one-port 
are located in the left half of the complex-frequency plane and form complex- 
conjugate pairs. 

00 The number of poles of the driving-point impedance of a passive one-port differs from 
the number of zeros by not more than one. 

oo The real and imaginary parts of the driving-point impedance of a one-port are related 
by a Hilbert transform pair, if the given one-port belongs to the class of 
minimum-impedance networks. 

<00 The driving-point impedance of a reactive one-port is a non-decreasing function of fre¬ 
quency (Foster’s theorem). 

<x> The synthesis of a one-port from the specified driving-point impedance is effected 
within the framework of the specified circuit structure. This can be done by the Foster 
(or partial fraction expansion) method or by the Cauer (continued-fraction) method. 
The poles of the transfer function of a stable two-port (four-terminal) network are 
located only in the left half-plane. 

The zeros of the transfer function of a stable two-port may be located in the right 
half-plane (nonminimum-phase networks). 

00 The poles and zeros of the power transfer function show quadrant symmetry. 

00 The poles of the transfer function of a maximally-flat (Butterworth) low-pass filter are 
located on the unit circle whose radius is equal to the cut-off frequency. 

00 The poles of the transfer function of an equal-ripple (Chebyshev) filter are located on 
an ellipse whose eccentricity is given by the ripple factor of the magnitude response. 

00 High-pass and band-pass filters can be generated from a known low-pass filter which 
plays the role of a prototype. 


Ch. 13 A Basic Theory of Linear Circuit Synthesis 


407 


Review Questions 

1. Write the characteristic equations for a one-port which is (a) open-circuited and (b) 
short-circuited. 

2. Define the property of a positive real (p.r.) function. 

3. What one-ports are called minimum-impedance networks? 

4 Name the basic properties of the poles and zeros of reactive one-ports. 

5. Give an example of a ladder network and show how its driving-point immitance 
(impedance or admittance) can be written in the form of a continued fraction expansion. 

6. What one-ports are called canonical? 

7. Name the network functions used to characterize two-ports. 

8. Why is it that the transfer function of a stable two-port must have a zero at infinity? 

9. Why is it that any ladder two-port is a minimum-phase network? 

10. What is the relation between the magnitude and phase responses of a minimum-phase 
two-port? 

11. Name the engineering applications of nonminimum-phase networks. 

12. How are the poles of the transfer function of a Butterworth low-pass filter located? 

13. Explain why Chebyshev polynomials are convenient for use in the low-pass filter 
approximation. 

14. What is the difference between the properties of Chebyshev and Butterworth filters? 

15. What is the principle of the structural synthesis of filters? 

16. Write the equations involved in the frequency transformation of low-pass to high-pass and 
band-pass filters. 


Problems 


1. Verify Eq. (13.16) with reference to the 
parallel RC-network examined in Example 
13.1. 

2. Show that the function 


Z(p) = 


(T 2 + l)(p 2 + 5) 
p(p 2 + 3)(p 2 + 7) 


is the driving-point (input) impedance of 
a realizable purely reactive one-port. 

3. Implement the Foster-form network 
whose driving-point impedance is 

_ P(P 2 + 4) 

z (p) = — 2 . r ~ 


4. Implement two Cauer-form networks 
whose driving-point impedances are 
specified in Problem 3. 

5. Prove that the first n - 1 derivatives of 


the power transfer function of an nth-order 
Butterworth filter vanish at con = 0. 

6. A Butterworth filter has a cut-off fre¬ 
quency of 10 kHz. In changing from 80 kHz 
to 160 kHz, the harmonic attenuation is 
increased by - 36 dB. Find the order of the 
filter. 

7. Find the transfer function of 
a 4th-order Butterworth filter. 

8. A Chebyshev filter has a ripple factor 
s = 0.3. What is the ripple factor of the same 
filter at con < 1 in decibels? 

9. Find the transfer function of an n = 2 
Chebyshev filter for 8 = 0.5. 

10. Show that a change in the resistance 
of the resistor R in a 2nd-order network 
causes the complex-conjugate poles of the 
transfer function to move round a circle of 
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radius a> 0 . Analyse also the case of a>co 0 . 

11. Implement a 2nd-order Butterworth 
filter with a cut-off frequency co c = 10 6 s - ' 1 . 
The filter is loaded into a resistor Rl = 
= 20 kQ. When specifying the element 
values, make sure that the network is 
physically realizable. 

12. Locate the poles of the transfer 
function of an n = 3 Chebyshev low-pass 
filter for which co c = 4xl0 4 s -1 and 8 = 
= 0.5. 

13. Implement the filter examined in 
Problem 12 by connecting in cascade 
a lst-order and a 2nd-order network. The 
load resistance of the filter is Rl=2 kD. 

Advanced Problems 

14. The real part of the driving-point 
impedance is 

100 

r+ 10 “ 12 cg 2 + 10 ~ 24 co 4 

Find the expression for the complex 
driving-point impedance and draw up the 
corresponding circuit diagram. 


15. Investigate the driving-point impe¬ 
dance Z (p) of a semi-infinite ladder network 
with a periodic structure of elements. 

16. There is a system which performs an 
ideal delay of signals for T seconds. Its 
transfer function is 


K(p) = exp(-pT) = 


1 

1 + pT+ (pT) 2 / 2! +T77 


Check to see if this characteristic can 
approximately be replaced with a rational 
function whose denominator has various 
orders. Find the poles of the transfer 
function to a first, second, and third 
approximation. 

17. Investigate the phase response of 
a Butterworth low-pass filter. Derive the 
equation for the group delay time for co = 0 
and co = co c . 

18. Calculate the impulse responses for 
2nd-order Butterworth and Chebyshev 
filters. 

19. Derive an equation defining the 
asymptotic slope in decibels for the response 
of a Chebyshev filter at frequencies 
substantially exceeding the cut-off frequency. 


Chapter 14 

Active Networks with Feedback. 
Self-Excited Oscillatory Systems 


This Chapter will be concerned v/ith a special class of active 
linear and nonlinear circuits in which all or a part of the output 
signal is fed back to the input. Quite aptly, they are called circuits 
or networks with feedback. 

The application of feedback makes it possible in some cases to 
improve the performance of the circuit involved to a marked 
degree. In other cases, given certain conditions, feedback may 
render the circuit unstable so that it jumps into self-excited 
oscillations. This principle underlies the operation of various 
self-excited oscillatory systems, above all harmonic oscillators which 
are integral parts of transmitters. 


The forward-path and 
the feedback elements 


14.1 The Transfer Function 

of a Linear Feedback System 


In order to make the results of the analysis that follows 
applicable to a wide range of various special cases, we will consider 
the problem of a feedback circuit in the most general terms, 
without exactly specifying the physical character of the input signal 
(excitation) and the output signal (response). 

The derivation of the basic relation. We will be concerned with 
the** linear system shown in block-diagram form in Fig. 14.1. 

Referring to the diagram, the system is seen to consist of two 
four-terminal networks. The active two-port whose transfer function 
is K(p) is the forward-path element of the system. The other 
two-port, usually a passive one, is called the feedback element with 
a transfer function (the feedback ratio) (3 (p). The arrowheads in the 
figure indicate the direction of signal flow around the system. 


Input ^ 


fi(p) 


Output 


Fig. 14.1 Block diagram of a linear feedback system 


At its input, the forward-path element has a network which 
combines the input signal and the output signal from the feedback 
element. If V\ n (p) and V out (p) are the Laplace transforms of the 
input and output signals, respectively, it is easy to see that 

V 0U t(p) = K(p)[Vi„(p)+ p(p) V ou t(p)] 0 4 - 1 ) 
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Hence we can directly derive the equation defining the transfer 
function of a system with feedback: 


Kf b (p)=V out (p)/Vin(p) = 


K(P) 

1-P (P)K(P) 


(14.2) 


▲ 

Solve Problem 1 


In accordance with the above equation, the frequency behaviour of 
the system depends equally on the transfer function K(p) and the 
feedback ratio fi(p). Therefore, it is possible, while leaving the 
forward-path element unchanged, to vary the frequency 
characteristics of the entire system over a wide range by varying the 
parameters of only the feedback element. 

Negative and positive feedback. Examine Eq. (14.2) for p=j(o. 
The frequency response of a system with feedback* is 


K{b(ja) l-P(/to)K0to) 

If at a specified frequency oo, 


(14.3) 


|1 -P(/<d)X(/©)|>1 


(14.4) 


then feedback will reduce the magnitude response of the system 
and, as a consequence, the amplitude of the output signal. This is 
known as negative ( degenerative ) feedback. If the converse is true, 
that is 


Sometimes, instead of 
the terms “positive” 
and “negative” feed¬ 
back, the wider con¬ 
cept of “complex” 
feedback is used. In 
this case, the value of 
the phase shift in the 
feedback element is 
specified 


11 — P (/©) K(j(o) | < 1 (14.5) 


we have positive ( regenerative ) feedback. 

Both forms of feedback are widely used in communication 
applications. It should be borne in mind, however, that positive 
feedback may cause instability in the system. To demonstrate, let, 
for example, P = P 0 and K = K 0 be positive real numbers. If P 0 is 
equal to zero initially and increases afterwards, then in accordance 
with Eq. (14.3) this brings about an increase in the overall gain or 
closed-loop gain Kn,. Should p o become equal to 1 /K 0 , then Kfo = 
= oo, and this implies the self-excitation of the system, or the 
appearance of an output signal when there is no signal at the input. 

Negative feedback makes it possible to improve considerably the 
frequency response of amplifiers. The examples that follow will 


* In engineering applications, this quantity is usually referred to as the 
closed-loop gain or the overall gain with feedback-Translator's note. 
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demonstrate some of the specific applications where negative 
feedback is warranted. 

Gain stabilization. Suppose we have an amplifier with a large, 
but insufficiently stable gain K 0 . It is required to build on its basis 
an amplifier with an improved gain stability. By applying a negative 
feedback loop to the amplifier, that is, by taking (3 (/oo) = — P 0 < 
we obtain on the basis of (14.3) 

Kfb = K 0 /(\ + Pq-Kq) 


Hence, 

dKfb/Kfb = [1/(1 + p„Ko)] (<1Ko/Ko) (14.6) 

If Po-Ko » 1, the relative instability in the resultant gain decreases 
by a factor of about P 0 K 0 . True, the gain itself decreases by the 
same factor, but this does not usually pose any problem because 
the desired gain can always be secured by adding more stages to 
the amplifier. 

Suppression of parasitic signals. Let the forward-path element of 
an amplifier be a cascade connection of two networks of gains K 1 
and K 2 , respectively. At their junction, an unwanted parasitic signal 
Fpar is injected. A negative feedback loop with the fraction fed back 
P is applied to the amplifier as a whole. It is required to determine 
the parasitic-signal gain K pM = F ou t/Ipar, that, is the extent to 
which the parasitic signal is allowed to reach output. 

Since obviously 

lout = K ~2 (Ipar — P^i lout) 


▲ 

Solve Problem 2 


Fpar 



then 

Kpar = fout/Ipar = K 2 /( 1 + P K X K 2 ) (14.7) 

It is seen that the parasitic signal breaking through into the 
system at a point close to its output, that is, with K 2 « K l9 will be 
substantially suppressed. This effect provides the basis for the 
control of nonlinear distortion in multistage amplifiers (Fig. 14.2). 



Fig. 14.2 Harmonic suppression in a multistage negative-feedback amplifier 
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In high-fidelity (hi-fi) 
amplifiers the non¬ 
linear distortion is a 
fraction of one per cent 


Here, negative feed¬ 
back exists, owing to 
the sign of the gain 
at the zero frequency 


As will be recalled (see Chap. 11), nonlinear distortion manifests 
itself as the appearance of signal harmonics because of the 
nonlinearity of the active elements. The harmonic content goes up 
as the signal amplitude is increased. Mentally, it may be pictured as 
if the unwanted harmonics are injected into the system from 
without, mainly in the final power stages of the amplifier. On the 
basis of (14.7) we conclude that negative feedback can substantially 
reduce the harmonic content at the output. Therefore, practically all 
amplifiers intended for the high-fidelity reproduction 
of audio signals (in radio broadcasting, sound recording) use negative 
feedback. 

Frequency response compensation. Consider a single-stage 
i^C-loaded transistor amplifier whose transfer function (see 
Eq. (8.43)) is 

K(p)= -K 0 /{ 1 +/rc eq ) (14.8) 

where K 0 = g m R Qq , and T eq = K e qCs. 

At zero frequency, the gain factor is negative 

K( 0)= -K 0 

By applying to this amplifier a frequency-independent feedback 
loop with a positive real parameter p(/co) = (3 0 , we will, on the basis 
of (14.2), have 

Kfb(0)= -K 0 /(l + p 0 K 0 ) 

Since 1 -I- p 0 IC 0 > 1, we have negative feedback. It is easy to verify 
that the feedback will remain negative at all frequencies because 


|l-P 0 K(/a>)| 


1 + 


Po^o 

1 + jCOTeq 


> 1 


at any frequency co > 0. On substituting (14.8) in the general 
equation (14.2), we obtain the following expression for the transfer 
function of a negative-feedback amplifier: 


*fb(p) = 


-K n 


(1 + fi 0 K 0 ) + P T eq 
Hence follows an expression for the magnitude response 

\Ka,m\ Kn 


[,/(! + P 0 K 0 ) 2 4- o) 2 t 


(14.9) 


(14.10) 


Figure 14.3 shows a set of amplitude response curves for 
amplifiers differing in the negative feedback level as defined by the 
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\K fb \ /K Q 



Fig. 14.3 Amplitude response of a single-stage KC-loaded amplifier for 
various levels of negative feedback 


parameter* 

d=$ 0 K 0 (14.11) 


The figure brings out the principal effect of negative feedback: the 
amplitude response of the amplifier is “equalized”, or compensated, 
owing to a reduction in gain at lower frequencies. As 
a consequence, the effective bandwidth of the amplifier is extended. 
Thus, on the basis of (14.10) the upper limiting, or cut-off, frequency 
cd c , defined as one at which the gain of the amplifier falls to 0.707 
times the maximum gain, K 0 , is 

CO c =(l + P 0 X 0 )/Teq (14.12) 

and increases linearly with increasing negative-feedback factor. 

The simplest way to apply negative feedback to a single-stage 
common-emitter amplifier is to place an additional feedback 
resistor Rfo in the emitter lead. The resultant increase in the input 
resistance brings about an increase in the emitter current and, in 
consequence, an increase in Ffb, the voltage across the feedback 
resistor. Therefore, the control voltage of the transistor becomes 

F B E=Fin-Ffb 

which is another way of saying that negative feedback does exist in 
the amplifier. 

Positive feedback in a tuned amplifier. Consider a single-stage 
small-signal tuned amplifier whose frequency response is 


K(j co) = 


— Kres 

1 +7Tckt(C0-C0 res ) 


(14.13) 


where K res = g m R res , and x c kt= 2Q/co res is the time constant of the 
resonant (tuned) circuit. 



▲ 

Solve Problem 3 


Only positive frequen¬ 
cies are considered 


* In books on practical radio engineering, it is often called the feedback 
factor, or return ratio, or loop gain-Translator's note. 
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Positive 

feedback 

/ 

Without 

positive 



Wres 


The effect of positive 
feedback on the ampli¬ 
tude response of an 
amplifier 



Regeneration 


Now suppose that to this amplifier we apply a frequency- 
independent positive feedback loop with the parameter p o such that 

r- / • \ K C/®) “ ^res/(l - Poores) ( A 

XfbOco) = , , Q =-—- (14.14) 


1 + Po^O) 


1+7- 


'tckt 


(O-COres) 


1 — Po .Kres 

From comparison of (14.13) and (14.14), it is seen that for 
Poores< 1, the positive-feedback amplifier has a frequency response 
of the same form as the amplifier without feedback. However, in the 
case of positive feedback there is an increase in the gain at 
resonance by a factor 1/(1 — P 0 X res ); the equivalent Q-factor of the 
resonant circuit of the amplifier is increased in the same proportion 


6eqfb— 6ec/(l — Poores) 


whereas the bandwidth of the amplifier is reduced by the same 
factor. 

These changes are explained by the fact that positive feedback 
produces regeneration-a partial compensation of the losses suffered 
by the resonant circuit. The energy required for the regeneration is 
drawn from the power supply. 

Positive feedback in a tuned amplifier can be produced by 
placing an inductor connected in series with the input circuit and 
inductively coupled with the resonant circuit. 

Despite a number of obvious advantages, positive-feedback 
amplifiers are used only seldom because they tend to jump into 
self-excited oscillation as the feedback factor P 0 K res goes to unity. 

Delayed feedback. Figure 14.4 shows a block diagram of a system 
in which the feedback path contains a scaling amplifier with 
a constant fraction fed back, p o , and a pure delay element which 
delays signals for a time x 0 . 

Let the gain K 0 of the forward-path element be frequency 
independent. Then 


Kfb(/®)= 


Kq 

1 - P 0 X 0 exp(-7C0T 0 ) 


(14.15) 



Fig. 14.4 Block diagram of a delayed-feedback system 
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The amplitude response of the system is 

| KfbO'ffl) I = / +° (14.16) 

]/l - (3 0 K 0 cos(ot 0 + ((3 0 X 0 ) 2 

If p 0 K 0 < the system is stable. Its amplitude response is 
represented by a periodic curve with alternating maxima and 
minima which implies that the character of feedback is different 
(positive or negative) at different frequencies. 

Delayed feedback makes it possible to build frequency-selective 
systems with a periodic amplitude response, known as comb filters 
so named because their response characteristics have the 
appearance of a comb. 

It is to be noted that this type of systems are capable of jumping 
into self-excited oscillation as P 0 K 0 ->1. 



The amplitude respon¬ 
se of the comb filter 


14.2 Stability of Feedback Networks 


This section will discuss the stability of feedback systems. The 
objective of the discussion is to confirm the qualitative reasoning 
pursued earlier with regard to self-excitation of positive feedback 
systems. 

The statement of the problem. Consider a system made up of an 
active forward-path element whose transfer function is K(p) and 
a feedback element whose transfer function is P (p). The output of 
the forward-path element is returned to the system’s input via the 
feedback element. It is assumed that no external input signal is 
applied, so that the system is self-contained. 

The equation of state is wrftten on the basis of the fact that 

V 0 ut(p) = K(p)P(p)V 0 ut(p) 



Hence, 


[l-P(p)X(p)]7 ou t(p) = 0 (14.17) 

Since F ou t(p) # 0 identically (otherwise the system would not be 
excited), then the equality (14.17) will be satisfied only for those 
values of p which are the roots of the characteristic equation 


• 

The characteristic 
equation of a feedback 
system 


l-P(p)K(p) = 0 (14.18) 

Let pi, p 2 , ... be the roots of the characteristic equation. Since the 
system is linear, the output signal will in the general case have the 
form 


iWO = exp (pit) + +2 e *p(p 2 0 + ••• (14.19) 

For the signal to be bounded, it is necessary that all the roots of 
the characteristic equation have negative real parts, that is, be 
located in the left half p- plane. A feedback system possessing such 
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properties will be absolutely stable in the sense defined in Chap. 8. 

Two problems may arise in the study of feedback systems. If the 
system being synthesized, say an amplifier, must be stable, we need 
a criterion with which we could immediately tell from the form of 
the functions (3(p) and K(p) that the characteristic equation has no 
roots lying in the right half p-plane. Conversely, if feedback is 
utilized to build an unstable self-excited oscillatory system, we need 
to know the roots of Eq. (14.18) defining the frequency at which the 
system will jump into self-oscillation. 

This section will be concerned with the first of the two problems. 
It is to be noted that the conclusions derived here apply not only to 
the stability of feedback systems, but to the stability of any linear 
dynamic system as well. 

Algebraic criteria of stability. Suppose that both the forward-path 
and the feedback elements are lumped-parameter networks and so 

K(p) = Pi(p)/QAp) 

m = P2(p)/Q2(p) (14.20) 


Hurwitz polynomials 


are the ratios of the polynomials in powers of p. On substituting 
(14.20) into (14.18), we obtain the characteristic equation of the 
system 

Q 1 {p)Q2(p)-Pi(p)P2ip) n 
Qi(p)Q2(p) 

Hence it follows that a feedback system is stable if all roots of the 
equation 

h(p) = Q 1 (p)Q2(p)-pAp)p 2 (p) = 0 

have negative real parts. In algebra, polynomials H(p) with such 
properties are called Hurwitz polynomials. 

Consider a special case of the Hurwitz polynomial 

H ( p ) = (p - Pi)(p - p 2 )(p - p 3 ) 


which has three roots one of which, p 1 — — a, is real negative, 
whereas the remaining two, 3 = — p ±jco 0 , are complex 
conjugate numbers with a negative real part. On direct substitution 
of the roots, we find that the polynomial 

H (p) = (p + a) [(p + p) 2 + co^] 

= p 3 + (a + 2P )p 2 + (P 2 + 2ap + coq )p + a(P 2 + ©o) 


contains all powers of the variable p, beginning with the highest 
one, and all of its coefficients have the same sign. These attributes 
only indicate the necessary conditions for a polynomial to be 
a Hurwitz polynomial. The complete solution of the problem was 
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obtained at the end of the last century and has been embodied in 
what is known as the Routh-Hurwitz criterion. The proof of the 
criterion can be found in [11]. We will only give the final result: 
For the equation 

a n p n + a n-iP nl + ••• + a i P + a o = 0 

with real coefficients to have roots lying in the left half p- plane, it is 
necessary and sufficient that the following quantities be positive: 

(1) The coefficients a n , a 0 . 

(2) The Routh-Hurwitz determinant 


The Routh-Hurwitz 
criterion 


a n -1 a n 
a n -3 a n-2 
D n _i = ^n-5 ®n-4- 


0 0 ...oo 

— l • • • 0 0 

a n- 3 a n- 2 ••• 0 0 


0 0 0 . a 0 a x 

and all of its principal minors. 


A 

Solve Problem 6 


Example 14.1. Using the Routh-Hurwitz criterion, test the stability 
of a system whose characteristic equation has the form 

p 3 + 2p 2 + 6p + 4 = 0 

We satisfy ourselves that a 3 , a 0 > 0. Next, we form the 
determinant 


D 2 = 


2 1 

4. 6 


= 8 > 0 


The only principal minor is 2>0. Hence the system is stable. 


An advantage of the Routh-Hurwitz criterion is the relative 
simplicity of calculations. A disadvantage is that its applicability is 
limited to lumped-constant networks because it is only for them 
that the transfer function is expressed in terms of polynomials. 

Graphical criteria of stability. Going back to the characteristic 
equation (14.18) we note that the product 

w(p) = P(p)K(p) 04.22) 

is nothing but the transfer function of a cascaded connection of 
a forward-path element and a feedback element. Usually, w(p) is 
called the open-loop transfer function of a feedback system. 

The function in (14.22) may be looked upon as a mapping of the 
complex p-plane onto another complex w-plane. If p l9 p 2 , ... are the 
roots of the characteristic equation 

l-P(p)K(p) = 0 



14-728 
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# 

The Nyquist locus 


The Nyquist stability 
criterion 


then, as can be readily seen, all of these points will be mapped in 
the w-plane into an only point, w = 1 . 

Hence we can directly formulate the rule for determining whether 
a feedback system is capable of self-excitation: If, under the 
conformal mapping of (14.22), the w-plane image of the right half 
p-plane contains the point w = 1 , the feedback system is closed-loop 
unstable. 

The imaginary (/co) axis in the p-plane maps into a curve in the 
w-plane. The equation of the curve in parametric form is 

w (/co) = (3 (/co) K (/co) (14.23) 

The parameter is frequency co which varies between the limits — oo 
and + oo. The curve is called the Nyquist locus of an open-loop 
feedback system. In all cases of practical interest, the amplitude 
response tends to zero with increasing frequency, so the Nyquist 
locus passes through the point w = 0. Also, the Nyquist locus is 
symmetrical about the real axis in the w-plane, because w (— jco) = 
= w* (/co). Obviously, the Nyquist loci for the systems in question 
are closed curves in the w-plane. 

In the theory of functions of a complex variable it is shown [11] 
that under the conformal mapping of (14.22) the image of the right 
half-plane is the area enclosed by the Nyquist locus. The stability 
criterion arising from the above procedure is known as the Nyquist 
stability criterion : If the Nyquist locus of an open-loop system 
encloses the point ( 0 , 1 ), the system is closed-loop unstable. 


Example 14.2. Investigate for stability a single-stage RC-coupled 
amplifier whose output is directly connected to its input. 

Here, obviously, P(p)=l, and 

K(p)= -K 0 l(\+px) 

where 

K 0 = g m R eq and x = R eq C s (see Chap. 8 ) 

The equation of the Nyquist locus takes the form 

w (/co) = — 0 ^ exp [/ (n — arc tan cox)] (14.24) 

Y 1 4- co 2 x 2 

The Nyquist locus plotted on the basis of Eq. (14.24) appears in 
Fig. 14.5. As is seen, the locus diagram is a circle of diameter K 0 . 
The top semi-circle is the image of the positive part of the 700 -axis. 
As the frequency rises, the amplitude response decreases, and the 
phase angle tends to 90°. 

Since the Nyquist locus is entirely in the left half-plane and does 
not enclose the w = 1 point, the connection of the output of the 
amplifier to its input leaves the system stable. 




K(p) 
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KfP) 


k 2 (p) 


A 

Solve Problem 7 



Fig. 14.5 Nyquist locus diagram of a single-stage KC-loaded amplifier. (The 
numerals in circles indicate corresponding points on the joo-axis and on the 
Nyquist locus.) 

Example 14.3. Using the Nyquist stability criterion, investigate for 
stability a two-stage aperiodically loaded amplifier whose transfer 
function is 

K(p) = K l (p)K 2 (p) = K 01 K 02 /(\ + pt ) 2 (14.25) 

To simplify the matters, it is assumed that the two stages have the 
same time constant; the gain constants at zero frequency, K 01 and 
K 02 , may in the general case be different. 

By a change of variable p = jco in (14.25), we obtain the equation 
for the Nyquist locus 

K K 

w (/co) = K 01 K 02 /( 1 +jim) 2 = y-^^-exp( -pare tan arc) (14.26) 

The Nyquist locus diagram for the amplifier in question appears 
in Fig. 14.6. 



Fig. 14.6 The Nyquist plot of a two-stage, aperiodically loaded amplifier 


14 * 















































420 


Part Two. Circuits 


If the overall open-loop gain at zero frequency K 0 = K 01 K 02 is 
greater than unity, then, on closing the feedback loop, the system 
turns unstable, because the w = 1 point is now enclosed within the 
Nyquist locus. 


▲ 

Solve Problem 8 


Apart from the Nyquist criterion, stability analysis uses a number 
of other geometric procedures applicable to linear feedback systems, 
such as the root-locus method and the Bode method [37]. They are 
widely employed in control system analysis. 


^inl 


v in2 

The opamp 



K out 


14.3 Active RC Filters 

Present-day advances in radio engineering and electronics, 
notably the advent of microelectronic components, have brought 
about sweeping changes in the previously widely used circuit 
designs. The changes have also affected the theory and practice of 
frequency-selective filter synthesis. 

Among other things, it has been found that no microminiature 
counterpart of the inductor can be fabricated. Yet, to implement 
conventional 2nd-order oscillatory ( RLC ) networks, one needs 
inductances (see Chap. 13). The way out has been found with the 
development of so-called active RC filters. An active RC filter is 
a combination of a passive RC -network and an active element, the 
latter usually being a complex transistor circuit which transfers 
some of the power it draws from a power supply to the passive 
network. 

In this section we will be concerned with one of the principles 
used to build active RC filters which include an operational 
amplifier used as the active element. 

The operational amplifier. This term refers to an amplifier with 
a large gain K 0 over a broad interval of frequencies, beginning at 
zero frequency. An operational amplifier has a high input 
impedance (in practice, tens or even hundreds of kilohms) and 
a fairly low output impedance (tens of ohms). Therefore, an 
operational amplifier may approximately be treated as 
a voltage-controlled voltage source. This model of a controlled 
active element is often used in circuit theory. Present-day 
operational amplifiers (or opamps, as they are frequently termed for 
short) have a gain of around 10 4 or 10 5 . As a rule, an integrated- 
circuit (IC) opamp has an inverting (“-”) input and a non-inverting 
(“ + ”) input. If V[ nl and V[ n2 are the input signal voltages at the 
non-inverting and inverting inputs, respectively, the output voltage 
is 

v out = ^o( y ini — v in2) 

Opamps are among the most widely used analog IC’s. 


(14.27) 
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Stability of a system with an opamp. If feedback is applied 
around a system incorporating an opamp, a condition of instability 
is very likely to develop. As an example, consider a system in which 
the output of the opamp is connected to the non-inverting input via 
a resistor R. Let C s be the stray capacitance at the input of the 
opamp. Since the input impedance of the opamp is infinitely high, 
the Laplace transform of the input voltage, V 1 (p), is related to the 
Laplace transform of the output voltage, V 2 (p\ in a simple way 


K 


= V 2 


1/pCs 
l/pC s + R 


On the other hand, 


K = v 2 /k 0 

The two equalities can be satisfied at the same time only if p is the 
root of the characteristic equation 

1/(1 +pRC s ) = l/K 0 


that is, 

p = (K 0 -\)/RC s 

Thus, at K 0 >1, the system is unstable; the voltages around the 
system build up in time as exp[(K 0 — \)t/RC s ~\. 

It is clear that a system in which the output of the opamp is 
connected to the inverting input via a resistor is stable. 

The principle of synthesis of active RC networks. Let us examine 
in a very general way one of the procedures for the synthesis of an 
active filter on the basis of an opamp (Fig. 14.7). This procedure is 
applicable to a large number of practical circuit designs. 



Fig. 14.7 Active RC-network built around an opamp 

The passive part of the device is a three-port made up of 
elements R and C. Terminal 1 is the input; the opamp is connected 
between terminals 2 and 3, so that use is made of the inverting 
input. 

This circuit is a special case of the feedback system examined at 
the beginning of this chapter. In order to find the transfer function 
of the system in question, we will describe the passive three-port 


R 

-cm- 



-0 


The signal at the 
inverting input is zero 
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Note that the inverting 
input of the opamp is 
used 


▲ 

Solve Problem 9 


with the aid of its Y-matrix: 

/l = YllFl + Yl2F 2 +Yi3K 3 

I 2 = Y 21 V 1 + Y 22 V 2 +Y 23 V 3 (14.28) 

/ 3 = Y 3 iFi +Y 32 F 2 +Y33F3 

If K 0 is the gain of the opamp, then 

v 3 = -k 0 v 2 

The input circuit of the opamp draws no current, so, on the basis of 
the second line in (14.28), we may write 

0 =Y 21 V 1 + (Y 23 -Y 22 /K 0 )V 3 

Hence, the transfer function of the system is 

K(p) = V 3 /V 1 = — Y 21 /[Y 23 — Y 22 /K 0 ] 

Assuming that K 0 » 1, we finally have 

K(p)= - Y 21 /Y 23 (14.29) 


Thus, the transfer function of an active RC filter is solely 
dependent on the properties of its passive network; the gain of the 
opamp and its other parameters are excluded from the final 
result. Therefore, the construction of systems varying in frequency 
response reduces to the synthesis of passive JRC-networks (in our 
case, a three-port) having the specified frequency response. The 
synthesis of three-ports is not taken up in this book. Therefore, we 
will take a simpler path-we will investigate some specific systems 
arranged in simple circuit configurations, which illustrate the 
circuit-engineering potentialities of the respective class of networks. 

The scale changer. This term refers to the circuit shown in 
simplified form in the schematic diagram of Fig. 14.8. 



Fig. 14.8 Scale changer: (u) schematic diagram; ( b ) passive three-port 


In order to determine the transfer admittances Yn and Y 2 3 , let us 
turn to the second line in Eqs. (14.28) and note that, say, Y 21 = 
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= I 2 /V 1 when terminals 2 and 3 are shorted to ground, that is, for 
V 2 =V 3 = 0. As is seen from Fig. 14.8b, Y 21 = \/R 1 . Similarly, 
Y 23 = 1/K 2 . On substituting the two expressions in (14.29), we get 


K(p) — — R 2 /Ri 


(14.30) 


Equation (14.30) explains the term “scale changer”: As is seen, by 
suitably varying the ratio of the resistors R ! and R 2 , the scale of 
gain (amplification) can be changed at will. Naturally, since the 
circuit does not contain any reactive elements, it has no frequency- 
selective properties. 

The analog integrator. If, in the circuit examined above, we 
replace the resistor R 2 with a capacitor of capacitance C, we will 
obtain a circuit which performs the operation of electric integration 
on the input signal (Fig. 14.9). To demonstrate, from analysis of the 
passive network we find that Y 21 = 1/.R and Y 23 = pC. Hence, on 
the basis of Eq. (14.29), we have 


K(p)= -1 /pRC (14.31) 




0 - 


m 


-0 


Fig. 14.9 Integrator built around an opamp: (a) schematic diagram; ( b ) 
passive three-port 


If Ri = R 2 , the de¬ 
vice acts as a sign 
inverter 


▲ 

Solve Problem 10 


Equation (14.31) confirms that the circuit has a transfer function 
which is the inverse of p, and so it integrates the signal applied to 
its input. 

The low-pass filter. So that the frequency characteristics of active 
RC filters can be varied at will, it is necessary to use passive 
networks with a greater number of elements than in the above 
cases. An attractive example of a system which has the properties of 
a low-pass filter is shown in Fig. 14.10. An elementary analysis, 
carried out along the same lines as for the above cases, leads us to 
the following expression for the transfer function of the system 

- Y 1 Y 3 

K{p) = Y s (Y 1 + Y 2 + Y 3 + Y,) + Y 3 Y a 


(14.32) 
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Fig. 14.10 Active RC low-pass filter 


The difference between 
the poles and zeros 
of the transfer fun¬ 
ctions of RC-networks 


Since the real parts 
of the poles are ne¬ 
gative with any choice 
of parameters, the net¬ 
work is absolutely 
stable 


Thus, the task of synthesis reduces to matching the admittances 
of the elements in such a way that the desired frequency 
characteristic is implemented. From the initial specifications, all 
admittances Y t through Y 5 are either resistors of conductance G or 
capacitors whose admittances are pC. What is important in 
principle is that the transfer function of an active filter is expressed, 
in accordance with Eq. (14.29), by the ratio of two transfer 
admittances Y 21 and Y 23 . Then the poles of K(p) coincide with the 
zeros of ^23 (p). It is shown in circuit theory [27] that the poles of 
any driving-point or transfer function of a passive RC-network can 
be located only on the negative real axis. However this restriction 
does not apply to the zeros of the corresponding functions, which 
may, as complex conjugate pairs, be located in any part of the left 
half p-plane. Thus, by combining a passive RC-network with an 
opamp, we may synthesize a 2nd-order oscillatory network which is 
the basic element for frequency filters with a variety of frequency 
characteristics. 

As will be recalled (see Chap. 13), the typical transfer function of 
a low-pass filter has the form 


K(p) = 


ap 2 + bp + c 


where A 0 , a, b , and c are constants. 

Referring to Eq. (14.32), it is seen that for the transfer function to 
have the above form, Y u Y 3 and Y 4 must be resistors, and Y 2 and 
Y 5 must be capacitors. Then, 


K(p) = 


_~ G 1 G 3 _ 

P 2 c 2 c 5 + pC 5 (G x + G 3 H- G 4 ) + G 3 G 4 


(14.33) 


The poles of the transfer function are located at points 
Gi + G 3 + G 4 


P 1,2 — 


2 C 2 


~±j 


' G 3 G 4 

C?C« 


Gi + G 3 H- G 4 


(14.34) 


The above formula makes it possible to synthesize oscillatory 
elements with any predetermined location of poles. 
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▲ 

Solve Problem 11 


Example 14.4. Synthesize a second-order Butterworth active RC 
low-pass filter with a cut-off frequency cu c =10 3 s" 1 . 

As is stated in Chap. 13, the transfer function of such a filter 
should have two poles 

p U2 = co c ( - 0.707 ±j 0.707) (14.35) 


Let us assume reasonable values for the resistors in the circuit 


and make them all equal, that is R x = R 3 = R 4 = 1.8 kQ. Then 
G 1 = G 3 = G 4 = 5.55 x 10" 4 S. 

On equating the real parts of (14.34) and (14.35), we obtain the 
expression defining the capacitance C 2 


Gj + G 3 + G 4 
2C 2 


= 0.707co c 


Hence, on substituting the known values, we find that C 2 = 1.18 pF. 

In order to determine the capacitance of capacitor C 5 , we equate 
the imaginary parts of (14.34) and (14.35): 

G 3 G * l3 f G i + G3 + G4V = 2 , 2 
C 2 C 5 4 y C 2 ) c/ 

On solving the above equation, we find that C 5 = 0.26 pF. The 
schematic diagram of the synthesized active Butterworth filter is 
shown in Fig. 14.11. 



Fig. 14.11 Active RC-filter with a maximally flat response at a cut-off fre¬ 
quency of 10 3 s “ 1 


Concluding remarks. i n this section we have examined the 
synthesis of active RC filters on the basis of opamps, amplifiers 
with an infinitely high gain. However, this principle does not 
exhaust the capabilities of present-day integrated circuits. Of 
particular interest in this respect are gyrators , active two-ports 
which have the property that when a capacitor is connected to the 
output port, a purely inductive input impedance is synthesized. In 
this way, filters can be built which do not contain any physical 
inductive elements. • 

For the properties of gyrators and other active elements used in The gyrator 
present-day RC filters the reader is referred to [32, 33]. 
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14.4 Self-Excited Harmonic Oscillators. 

The Sma 11-Signal Condition 

In some situations active networks can give rise to periodic 
self-excited oscillations. The term “self-excited” refers to the fact that 
the oscillations are produced and maintained without any external 
periodic excitation of the system. Devices generating self-excited 
oscillations are frequently called self-excited oscillators or, simply, 
oscillators. 

For its operation any oscillator depends on the fact that power 
from an external power supply is fed via an active element, such as 
a transistor, to an oscillatory system (a resonant or tank circuit). 
The signal that controls the transistor is picked off the same 
resonant circuit and applied to the control electrode of the 
transistor over a feedback path. 

With suitably chosen parameters, such a system becomes 
unstable. Any minute oscillations, such as caused by thermal noise, 
tend to grow in amplitude without bound. However, as their 
amplitude builds up, the nonlinear properties of the control element 
• begin to play a progressively greater role, so that the amplitude 

The steady state reaches a steady-state value and remains practically constant 

afterwards. The oscillator is then said to operate in a steady state. 

The analysis and synthesis of oscillators poses two basic 
problems: 

1. Determine the conditions under which the circuit with 
feedback becomes unstable, that is, jumps into self-excited 
oscillations. 

2. Determine the amplitude and frequency of self-excited 
oscillations in a steady state. 

As will be shown shortly, the first problem is simpler to solve, 
because at the low amplitudes of self-excited oscillations, typical of 
the initial stage of the process, the nonlinear element may be 
replaced with an equivalent linear element. It is more difficult to 
solve the second problem because, in a more general sense, it 
involves an analysis of a feedback system under conditions when 
nonlinear effects may not be neglected. 

Self-excitation of an elementary oscillator. Let us begin our study 
of the processes that take place in oscillators with what is known as 
a transformer-coupled oscillator (Fig. 14.12). 

Referring to the figure, the oscillatory system is an LCR resonant 
circuit, and the feedback element is a coil Lfb so placed that the 
magnetic flux it sets up partly threads the coil L. 

Suppose that in one way or another small oscillations have been 
excited in the circuit. If v is the voltage across the capacitor (and, in 
consequence, at the control electrode of the electron device), then, 
by the Kirchhoff second law, we may write the following differential 
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Fig. 14.12 Transformer-coupled oscillator 

equation to describe the system in question: 

LCd 2 v/dt 2 + RCdv/dt + v = ± Mdi/dt (14.36) 

where i is the current in the feedback circuit. The sign on the right- 
hand side of (14.36) is chosen according as the coils L and Lfb are 
connected in opposition or aiding. 

Now we will make a basic assumption: Let the control voltage 
v be so small that the electron device may well be replaced with 
a controlled source of current which is a linear function of the 
control voltage: 

i = io + 9dV (14.37) 

where i 0 is the direct component of current (of minor consequence 
for the subsequent discussion), and gd is the dynamic (or 
incremental) transconductance defined as the slope of the current- 
voltage characteristic of the electron device at a selected operating 
point. On combining (14.36) and (14.37), we get 

d 2 v/dt 2 + (R/L+ Mg d /LC)dv/dt + cojfc = 0 (14.38) 


where oo 0 = 1 /j/lC is the natural frequency of the lossless resonant 
circuit. It is important to note that Eq. (14.38) is a linear differential 
equation with constant coefficients. By varying the mutual 
inductance M, we can change the coefficient of the derivative dv/dt 
at will. The sign and magnitude of the coefficient determine, as will 
be recalled, the character of the free response of (or natural 
oscillations in) this dynamic system. If we choose the upper signs in 
Eqs. (14.36) and (14.38), feedback will lead to regeneration (already 
examined previously). If we let M reach its critical value, M cr , 

M cr = RC/g d = l/(»oQgd (14.39) 

where Q is the Q-factor of the resonant circuit without 
regeneration, then Eq. (14.38) takes the form 

d 2 i;/dt 2 + C0 q^ = 0 


An oscillator can be 
built around a bipolar 
transistor on allowing 
for the additional atte¬ 
nuation caused in the 
oscillatory system by 
the finite output impe¬ 
dance 



Alternatively, the tu¬ 
ned circuit of a trans- 
former-coupled oscil¬ 
lator may be connected 
in the output lead of 
the electron device 


m 

The critical value of 
mutual inductance 
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which is typical of an ideal lossless oscillatory system. If M >*M cr , 
the system becomes unstable. On introducing the parameter 

a = j (Mg d /LC - R/L ) > 0 

we get the differential equation 
d 2 v/d t 2 — 2adv/dt + (OqV = 0 

which describes sine-cosine oscillations whose amplitude 
exponentially builds up with time: 

v (t) = A exp (at) cos ]/co^ - a 2 t + B exp (at) sin ]/oog - a 2 f (14.40) 

where A and B are constants which depend on the initial 
conditions. Practically, a«co 0 always, so, in accordance with 
Eq. (14.40), the carrier frequency of the oscillations produced in the 
linear mode is very close to the natural frequency of the resonant 
circuit. 

It is important to stress the physical significance of the correct 
choice of the sign in Eq. (14.38): For the system to be capable of 
self-excitation, it is essential that any perturbation of its state 
should produce a feedback signal and that the feedback signal 
should combine with the initial perturbation so as to augment it. 
This is, in fact, the definition of positive feedback as it is treated 
in the theory of oscillatory systems. 

Three-terminal oscillators. A disadvantage of a transformer- 
coupled oscillator is that it needs two inductors. In practice, use is 
more often made of circuits in which the feedback voltage is picked 
off an intermediate tap on the tank circuit. Quite aptly, they are 
called three-terminal oscillators. In the form shown in Fig. 14.13, 
usually called the Hartley oscillator, the intermediate tap is located’ 
on the inductive element of the tank. 

Let us analyse the condition for the self-excitation of the Hartley 
oscillator. We will do this by developing and solving the 
characteristic equation for the circuit with its feedback loop closed. 

If Fin and F out are the Laplace transforms of the input and out¬ 
put signals of the system with its feedback loop open (Fig. 14.13h), 



Fig. 14.13 Hartley oscillator: (a) schematic diagram (with the power and 
bias supplies omitted); (i>) same, with the feedback loop open 
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and the transfer function of the system is K(p), then the 
characteristic equation describing the closed-loop system has been 
found to be 

K(p)= 1 (14.41) 

In order to find K(p\ we should note that, for the assumed 
direction of current flow, the voltage across the tuned circuit is 

fckt = — 9d^ab (p) I'm 

where 


Zab(p) = ktdZckt{p) 


Here, /c t d = L 1 /(L 1 + L 2 ) is the tapping-down factor for the tank, 
and Z ckt (p) is the input impedance of the parallel tank between 
points a and c, that is, with connection across the whole of the 
tuned circuit. Deeming the tuned-circuit Q sufficiently high, we 
obtain the following approximate equation: 


Z c kt(p) — ^res 


1 


- + 


1 


1 4- px c kt — JCOres'Cckt 1 + P T ckt +7®res T ckt 


(14.42) 


Finally, we note that at the resonant frequency 
COres = 1/]/C^i + L 2 ) C 

current resonance will exist in the tuned circuit and so 


It is noted that the 
magnitude of the input 
impedance of a parallel 
resonant circuit is a 
maximum at 
P ~ i/® res 


F ou ,= -(La/LJFckt ' (14.43) 

On combining the above equations, we may re-write the 
characteristic equation (14.41) as 

(LJLJkfagdZcktip) = 1 (14.44) 


or 

_ 1 _ _ 1 = 1 

1 + pXckt — jtOres^ckt 1 + P^ckt+7 tt) res^ckt agdR res 

where a is the coupling parameter defined as 
a, — + L2) 


Equation (14.45) has two complex conjugate roots: 


QQdR res . . 

P 1,2 = —- ±J 

^ckt 


C0? es - 


(cigdR res) 2 

Tckt 


(14.45) 


(14.46) con) jition for the 
self-excitation of a 
three-terminal oscilla- 

(14.47) tor 


Thus, it is seen that the 


Hartley oscillator will jump into 
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self-excited oscillation subject to the condition 


&gdRres > 1 (14.48) 


Example 14.5. The tank circuit of a Hartley oscillator is tuned to 
cores = 6 x 10 6 s “ 1 . The dynamic transconductance of the electron 
device at the operating point is gd=l mA/V. The tank has Q = 40, 
the tank capacitance is C = 400 pF. Find the values of L x and L 2 
necessary for the oscillator to jump into and sustain oscillations. 
The characteristic resistance of the tank circuit is 

p = l/co res C = 416.6 Q 

Hence, the resonance resistance is 

Rres == pQ = 16.6 kn 

On the basis of Eq. (14.48), for the oscillator to jump into 
oscillation it is necessary that 

a> l/g d R VQS = S.57 x 10" 3 

Allowing some margin, we take it that a = 10" 2 . The total 
inductance of the tank circuit is 

L x + L 2 = 1/cflres C = 69.4 pH 

Using Eq. (14.46), we obtain a quadratic equation by which we can 
find L 2 : 

L 2 (69.4-L 2 )/(69.4) 2 = 10 " 2 

which has two roots: L 2 = 0.7 pH and L 2 = 68.7 pH. From 
practical considerations, preference is given to the lower value of L 2 
at which the oscillator will obviously develop a higher voltage 
across the tank circuit. 


Another form of the three-terminal oscillator is the Colpitts 
oscillator in which the feedback voltage is picked off the common 
connection of two voltage-dividing capacitors C 1 and C 2 . The 
condition for the self-excitation of the Colpitts oscillator is analy¬ 
sed along the lines similar to those for the Hartley oscilla¬ 
tor. 

RC phase-shift oscillators* At frequencies below several tens of 
kilohertz it is increasingly more difficult to use LC resonant circuits 
as tanks for oscillators, mainly because the inductive elements 
become too large in size and weight. It is usual, therefore, to 



* Otherwise called RC harmonic oscillators.- Translator's note. 
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employ RC oscillators which are combinations of active two-ports 
(amplifiers) and passive RC feedback networks. 

Let K (p) be the open-loop transfer function and K (p) = 1 be the 
characteristic equation describing the behaviour of a system with its 
feedback loop closed. For the system to be unstable and capable of 
producing harmonic oscillations in a steady state, it is necessary 
that the characteristic equation should have at least one pair of 
complex conjugate roots with a positive real part. The imaginary 
part of the roots will then define the frequency of oscillation. 

Let us derive the condition for the self-excitation of a widely used 
oscillator type with two RC networks (Fig. 14.14). The basic 



Fig. 14.14 Oscillator with two RC-networks: (a) schematic diagram; (b) 
same with the feedback loop open 


element of the oscillator is an ideal amplifier which has a real and 
positive gain constant K 0 . The amplifier output is connected to its 
input via a passive RC two-port whose transfer function in 
accordance with Fig. 14.14h has the form 


KAp) = 


_ Pfl _ 

(1 + px 1 )(l +.px 2 ) + px'* 


(14.49) 


where x 1 =R 1 C 1 , t 2 = R 2 C 2 , and x' = R 2 C V The characteristic 
equation of the oscillator, K 0 K 1 {p)= 1, may obviously be written 
as 


p 2 XiX 2 + p [x x + x 2 - x' ( K 0 - 1 )] + 1 = 0 


(14.50) 


The system becomes unstable when the coefficient of p crosses 
zero. In other words, for the oscillator to jump into self-sustained 
oscillations it is necessary that 


Xi + X 2 - x' (K 0 — 1) < 0 

Hence follows the condition to be satisfied by the gain constant of 
the active element: 


K 0 >1 + 


R^C± -h R 2 C 2 
JR 2 Ui 


• 

The condition imposed 
on the roots of the 
characteristic equation 


This requirement 
stems from the Routh- 
Hurwitz criterion 


(14.51) 
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Strictly speaking, the 
frequency of oscilla¬ 
tion depends on the 
gain of the active ele¬ 
ment 


▲ 

Solve Problem 13 



• 

The power balance 
around an oscillator 

• 

Internal feedback 


The laser 


Notably, if the two RC-networks are the same, the system will jump 
into oscillation at K 0 > 3. 

The imaginary part of the roots of Eq. (14.50) depends not only 
on the circuit parameters R lf R 2 , C x and C 2 , but also on the gain 
constant K 0 . To determine the frequency of oscillation, it may be 
approximately taken that the oscillator is operating at the 
boundary of excitation, and so the coefficient of p is equal to zero. 
Then from the characteristic equation 

P 2 t 1 t 2 + 1= 0 

the frequency of oscillation is found to be 

co 0 sc=l/l/KAQA (14.52) 


In conclusion, it is to be noted that RC phase-shift oscillators are 
inferior to LC-oscillators from the viewpoint of the harmonic 
content of the oscillations generated. This is because the feedback 
loop does not contain any resonant circuits and cannot sufficiently 
attenuate unwanted harmonics. An acceptable waveform of the 
resultant oscillations is secured through variations in the circuit 
design, such as the use of an additional nonlinear feedback loop 
with lag [37]. 

Internal-feedback oscillators. The types of oscillators examined 
above include suitably designed positive feedback loops. However, 
it is possible to build oscillators on a different principle, namely by 
introducing a negative conductance in the tank circuit. 

If, for example, R res is the tank resistance at resonance and 
Gneg = gd < 0 is the parallel negative conductance corresponding to 
a small amplitude of oscillations, then the condition for the 
self-excitation of the system consists in making up for tank-circuit 
loss (see Chap. 8): 

-Qd> 1 /R res (14.53) 

Let this condition be satisfied. As the oscillations build up owing to 
the nonlinear element, the rate of build-up slows down. In the 
steady state the power dissipated in the tank circuit over a period 
of natural oscillations is exactly equal to the power fed into the 
tank circuit from external sources over the same time interval. The 
self-regulation of the steady-state amplitude by this mechanism is 
known as internal feedback. 

Distributed-parameter oscillators. Internal-feedback oscillators 
include a very interesting and practically very important variety 
built around sections of distributed-parameter transmission lines. 
A typical example is the laser , the name being derived from the 
initial letters of “Light Amplification by Stimulated Emission of 
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(a) ( b) 


Fig. 14.15 Explaining the operation of a laser: (a) sketch; ( b ) equivalent 
circuit; ( 1 ) reflecting mirror; (2) semitransparent mirror 


Radiation.” This is a harmonic oscillator operating at optical 
wavelengths (Fig. 14.15). 

In one form, a laser consists of two plane-parallel mirrors 
which make up a distributed oscillatory system known as the 
Fabry-Perot resonant cavity. The cavity is usually filled with an 
active medium, such as a mixture of helium and neon. In this 
medium, external pumping produces what is known as population 
inversion, that is, the preponderance of excited atoms over the 
nonexcited ones. On falling to a lower energy level, the excited 
atoms emit quanta of electromagnetic energy at a frequency equal 
to one of the resonant frequencies of the oscillatory system. If the 
emitted power exceeds the power delivered to load through 
a semitransparent mirror, the system jumps into self-sustained 
oscillation. 

In order to get a quantitative idea about the condition for the 
self-excitation of a laser, consider its simple one-dimensional model 
shown in Fig. 14.15h. It consists of a short-circuited 
transmission-line section loaded into a resistor R l. As the theory of 
transmission lines tells us [26], the harmonic wave process in a line 
is described by a complex propagation constant 

y = a +7'P = |/(K X +jcoL i )(G 1 + ja)C 1 ) (14.54) 

which involves the per unit length parameters R l9 G l9 L 1 and C t . 
By the theory of distributed parameter circuits, the effect of 
pumping is customarily interpreted as rendering the per unit length 
shunt conductance negative: G l =—g 1 . Then, deeming for 
simplicity that R x = 0 and that the conductance only slightly affects 
the phase velocity, that is, g 1 «(oC 1 , on the basis of (14.54) we 
have 


The operating prin¬ 
ciple of a laser 


Alternatively, this sys¬ 
tem may be described, 
assuming that the per 
unit length resistance 
is negative 


^"^l^w+jPo 


(14.55) 


where Z w = ]/LJC\ is the wave impedance of the line, and p 0 = 
= co ]/L 1 C l is the phase constant. 

The load resistor is connected in parallel with the input 
admittance of the short-circuited line section of length /, equal, as 
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There exist an infinite 
number of frequencies 
at which a distribu¬ 
ted-constant oscillato¬ 
ry system is capable 
of self-excitation 


The condition for the 
self-excitation of a 
distributed-constant 
oscillatory system 


will be recalled, to 
Tin = (1/Z W ) coth yl 

On substituting for y from (14.55) and noting that at a«(3 

, , , _ a/ —/cot (3/ a/ 

coth (a/ +j$t) X --———» — 2 —7cot (3/ 

1— 7 a/cot (3/ sin z p/ 

we get 



0llZ W 
2 sin 2 p 0 / 


-j cot p 0 / 


(14.56) 


For the system to become unstable, it is required that the 
negative conductance of the line should balance the positive load 
conductance. This leads us to the condition for self-excitation 

g 1 l/(2sin%l)>l/R L (14.57) 


The frequency of oscillation, co osc , is found from the resonance 
condition according to which the reactive component of the input 
impedance of the line must vanish: 

cot p o / = 0 

Hence, 

P 0 / = (n/2)(2k + 1 ) k = 0 , 1 , 2 , ... 

Therefore, 

coosc = - /— (2k +1) 

2l]/L 1 C 1 

At the frequency of oscillation, 

Isin P 0 /| = l 

so the condition for oscillation takes the form 
9 i > 2 /^l 

As follows from the above expression, the excitation of 
a distributed-parameter oscillator of the type in question becomes 
progressively easier with an increase in the load impedance, that is, 
as the line comes closer to the open-circuit condition with respect 
to the output terminals. 
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14.5 Self-Excited Harmonic Oscillators. 

The Large-Signal Condition 

This section will outline the theory of oscillatory systems 
operating under large-signal conditions when the nonlinearity of the 
electron device cannot be ignored any longer. The material 
presented is based on an approximate solution of the nonlinear 
differential equation of the oscillator. 

The abridged equation method. We go back to the simplest 
transformer-coupled oscillator and assume that the current-voltage 
characteristic, i = f(v), of the active element is specified or known in 
advance. Since 

di/dt = (df/dv)(dv/dt) 


we may write the nonlinear differential equation (14.36) descri¬ 
bing the behaviour of the oscillator under any conditions as 



M df 
LC dv 


dv - 

—+ o ,„,-0 


(14.58) 


Methods which would yield an exact solution for an equation 
like that are nonexistent. As a rule, one has to resort to simplifying 
assumptions of physical character and seek approximate solutions. 
In the case on hand, it is useful to note that the oscillator contains 
a high-Q tank, so, despite its nonlinearity, the voltage across 
the tank must resemble a harmonic wave at frequency co 0 very 
closely. 

Let us seek an approximate solution for Eq. (14.58) in the form 


v(t) = V(t)cos(o 0 t 


such that the amplitude V{t) is assumed to be a slow function of 
time in the sense that 


| dk/dt |«co 0 1 V\ 

On this basis, in the expression for the derivative 
dv dV 

—— = —— cos co 0 t — co 0 Vsm co 0 t 


we may retain only the second term 

—^-c0 o FsinoV ( 14 - 59 ) 


The choice of the sign 
for M assures the 
self-excitation of the 
system 


The derivative d 2 V/df 
is small due to the 
assumption that the 
amplitude varies slow¬ 
ly 
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The abridged equation 
of an oscillator 


The mean transcon¬ 
ductance 


Similarly, 

d 2 v d 2 V dV 

-faT = cos ®of - 2co 0 — sin co 0 f 

dV 

- cooKcosco 0 f ^ — 2© 0 -^-sin © 0 t — ro^Fcos © 0 t (14.60) 

On substituting (14.59) and (14.60) into (14.58), we get what is 
known as the abridged differential equation 


dV 1 / R M df\ 

— + —(- — I V= 0 

dt 2 \ L LCdvJ 


(14.61) 


which approximately describes the events taking place in an 
oscillator using a high-Q tank circuit. 

The abridged equation method simplifies the subsequent steps of 
analysis, because Eq. (14.61) contains only a first-order derivative. 

The mean transconductance. The derivative df/dv in the second 
term of Eq. (14.61) is the local value of the dynamic (incremental) 
admittance of the nonlinear element. Since we assume that the out¬ 
put signal of the oscillator only slightly differs from a harmonic 
wave at frequency co 0 , then the current i(t) is a periodic time 
function expandable into a Fourier series: 

i =f(v) = I 0 + /j cos oo 0 t +1 2 cos 2© 0 t +... 

On discarding the harmonics, we get 

f~I 0 + 1 1 cos ©o t 

On the other hand, 

v(t) = Fcos co 0 t 

and so 


da 


df /da 
~dt/~dt 


= h/V 


By definition, the coefficient of proportionality between the 
fundamental amplitude of the current and the amplitude of the 
voltage at the control electrode is the mean, or fundamental, 
transconductance g mi : 


9m 1 (V) = I 1 (V)/V 


(14.62) 


On inserting the mean transconductance, we may re-write the 
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abridged equation (14.61) as 


dV 1 f R M 

ir + J ~T~Tc 9m 



v= o 


(14.63) 


From an analytical point of view, it is more convenient when the 
current-voltage characteristic has the form of a power series: 

i ( v ) = a 0 + a x v + a 2 v 2 +... 


▲ 

Solve Problem 14 


Then, as will be recalled (see Chap. 11), 

I 1 =a 1 V+ 3 / A a 3 V 2 + 5 / 8 a 5 V 5 + ... 
so that 

9mi (F) = a 1 + 3 / 4 fl 3 F 2 + 5 / 8 a 5 V 4 + ... (14.64) 

On substituting the above expression of the mean 
transconductance in the abridged equation (14.63), we obtain 
a lst-order nonlinear differential equation which can always be 
solved by separation of variables. 

Steady-state operation of the oscillator. By definition, the 
steady-state output signal of an oscillator has a constant amplitude. 
On setting dV/dt = 0 in Eq. (14.63), we get 


g mi (V) = RC/M 


(14.65) 


The concept of mean 
transconductance was 
introduced by Yu. B. 
Kobzarev (USSR) who 
formulated a quasili- 
near theory of self- 
excited oscillators in 
the 1930s 


• 

The equation defining 
the steady-state ampli¬ 
tude of self-excited 
oscillations 


the positive roots of which define the steady-state amplitude of 
oscillation. 

Example 14.6. Consider an oscillator in which the active element 
has the following mean transconductance as a function of the 
amplitude of control voltage: 

gmi{V) = a 1 + 3 / i a 3 V 2 

where a x = gd= 15 mA/V, and a 3 = -4 mA/V 3 . 

The parameters of the oscillator are as follows: 

© 0 = 10 7 s -1 , Q = 30, and M = 1 pH 

Before we can determine the steady-state amplitude, we should 
first find 

Solve Problem 15 5 - RC/M > l/c.fiM = 3,33 x 1(T ’ S 

On the basis of Eq. (14.65), the steady-state amplitude in our case 
satisfies the quadratic equation 

+ 3 /4 fl 3^S= \ 
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On solving it, we get 


V= 



= 1.97 V 


The characteristic g mi {V) may have any one of the two forms 
shown in Fig. 14.16, depending on where the operating point of the 
£ nonlinear element is located. 

Soft and hard self- ^ mean transconductance monotonically decreases with 

excitation increasing amplitude of the control voltage, the oscillator is said to 

be operating with soft self-excitation. The respective plot is shown 
in Fig. 14.16a which also shows the so-called feedback line-a 
horizontal line whose ordinate is RC/M. The intersection of the 
9mi {V) curve and the feedback line defines the only amplitude of 
steady-state oscillation, F ss . 




RC/M 


Fig. 14.16 Typical plots of mean transconductance versus the amplitude of 
control voltage: (a) “soft mode” characteristic; (b) “hard mode” 
characteristic 


The difference between 
the stability of linear 
and nonlinear oscilla¬ 
tory systems 


The situation is more complicated when the oscillator is 
operating with what is called hard self-excitation. Here, as is seen 
from the plot in Fig. 14.166, two steady states are possible, one 
with amplitude F SS1 , and the other with amplitude V SS2 . 

Stability of steady states. In order to see which of the two steady 
states is actually effected, we must define the crucial matter of their 
stability. An oscillatory process is said to be in a stable steady state 
if, after any small deviations of the amplitude of harmonic 
oscillations from the steady-state value, the system tends to go back 
to the state in which the amplitude is steady. Conversely, the 
process associated with an unstable steady state will tend to change 
its amplitude so as to move to another stable point. 

The stability of a steady state is a concept specific of nonlinear 
oscillatory systems. It should be recalled that with reference to 
a linear dynamic system, we may only speak of stability or 
instability in the quiescent state (the small oscillation condition). 

Consider the abridged equation (14.63) of the oscillator and 
assume that the amplitude V of self-sustained oscillations has 
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departed by a small amount U from the steady-state value: 
V=v ss +U ( 14 - 66 ) 


Then 

Qm\ (^ss) + At/ 

where A = dg mi /dVis the slope of the mean transconductance curve 
at the steady-state point. On substituting (14.66) into (14.63), we get, 
subject to Eq. (14.65), a differential equation in the amplitude 
increment 


dU 

dt 


AM 
2 LC 


(U 2 + UV SS )* 


AMV SS 
2 LC 


U 


(14.67) 


This simple linear differential equation points out that the sign of 
the derivative dU/dt depends on the sign of A. Thus, if A < 0, then 
U and dU/dt take different signs. Therefore, if, for one reason or 
another, the amplitude Fof the oscillation has become greater than 
F ss , that is, U > 0, then, by virtue of Eq. (14.67), the derivative 
dU /dt < 0 , and so with time the oscillatory system will regain its 
steady state. 

It is easy to see that an oscillator operating in the soft 
self-excitation mode does possess the above property. Suppose that 
the mutual inductance M is so small that the feedback line 1 does 
not intersect the gmi(V) curve. The only steady state available to 
the system now is the quiescent state where the oscillations have 
zero amplitude. If M is increased, then at M cv = RC/gd (line 2) the 
oscillator will excite itself, no matter how small the amplitude of 
steady-state oscillation may be. Any further increase in M will lead 
to a gradual increase in the amplitude of the resultant oscillations 
(line 3). 

The events take a different course in an oscillator operating in 
the hard self-excitation mode. If initially the system is in the 
quiescent state and the feedback line takes up position 1, then no 
self-excitation will occur, despite the fact that there are two 
steady-state points, namely the unstable point a and the stable 
point b. If, however, some external sources drive the system into 
harmonic oscillations at resonant frequency and with an amplitude 
corresponding to point a, then, since A > 0 (the mean 
transconductance increases with increasing amplitude), the resulting 
oscillations will be unstable. Their amplitude will build up only 
until the system has moved to the stable point b characterized by 
a constant steady-state amplitude F SS1 . 

An oscillator with hard self-excitation is capable of jumping into 
self-sustained oscillations as well. For this to happen, the feedback 
line must take up position 2 in which the steady state with an 
infinitesimal amplitude of oscillations is unstable. As follows from 
the foregoing, the oscillations thus excited will keep building up 


The steady-state stabi¬ 
lity criterion 
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A 

Solve Problem 16 


Oscillatory hysteresis 



The boundaries of soft 
and hard self-excita¬ 
tion 


until their amplitude reaches in the limit the steady-state value F SS2 . 
If we now reduce M, the amplitude of oscillations will gradually 
dimmish until it is equal to F SS3 , and the feedback line takes up 
position 3 in which it is tangent to the g m (F) curve. Any further 
decrease in M results in quenching the self-excited oscillations; their 
amplitude suddenly drops to zero. 

Thus, in an oscillator with hard self-excitation, oscillations occur 
and disappear at various values of the feedback factor. This 
property is called oscillatory hysteresis. 

Dependence of soft and hard self-excitation of an oscillator on 
the location of the operating point. As already noted, the soft 
self-excitation mode differs from the hard mode in that at small 
amplitudes of oscillation the mean transconductance g m (V) 
decreases with increasing F in the former case and increases in the 
latter case. Let the current-voltage characteristic of the nonlinear 
element be described by a power series. Then (see Eq. (14.66)), at 
low values of V the following relation exists: 

9mi (F) = a x + 3 / 4 U 3 K 2 

from which it follows that the oscillator operates in the soft mode 
when a 3 < 0, or in the hard mode when a 3 > 0. As will be recalled, 

1 d 3 i 
3 3! dt > 3 

with the derivative being evaluated at the point corresponding to 
the initial bias voltage applied to the nonlinear element. 

As a rule, a plot of i(v) yields a smooth curve monotonically 
increasing from zero to some constant level. If we differentiate this 
relation three times graphically, we will see that the soft mode is 
realized when the operating point is located in the middle portion 
of the characteristic. 

Transition to a steady-state amplitude. The abridged equation 
method makes it possible not only to find steady states and to 
analyse them for stability, but also to investigate the transition of 
the system to the steady-state amplitude of oscillations. To illustrate 
the method, let us find the manner in which the amplitude V(t) 
varies with time in an oscillator operating in the soft mode, 
assuming that at t = 0 the system sustains harmonic oscillations at 
resonant frequency and some known amplitude F 0 . 

The problem reduces to solving the equation 

—+ i ( R 3a 3 M \ 

df 2 \ L LC 4 LC ) 


subject to F(0) = F 0 . 


V= 0 
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Let us introduce abbreviated notation: 



P = 


3 a 3 M 
8 LC 


<0 


We can multiply both sides of the abridged equation 
dV 


d t 


= (q+pF 2 )F 


by F and obtain an equivalent form: 
dF 2 


- = dt 


(14.68) 


(14.69) 


2(a+PF 2 ) F 2 

By expanding the left-hand side of (14.69) into partial fractions, 
we get 

— (P/2a)dF 2 dF 2 /2a _ df (14 . 70) 

a+pF 2 F 2 

Finally, on integrating subject to the initial condition, we 
obtain the solution of the problem as 

1 F 2 (a + PFq) _ 

2a Fo(a+ PF 2 ) 

Hence, the final result is 


The events taking 
place in an oscillator 
with hard self-excitati¬ 
on are treated similarly 


= F 0 |/aexp(af) 

j/a + PFq [1 — exp(2at)] 


(14.71) 


As t tends to infinity, the amplitude of oscillations tends to 
a constant steady-state level 


F ss =l/oc/-p = 


' / RC/M - a x 

I 3 Ua 3 


(14.72) 


which checks with the result obtained in Example 14.6. 

It is important to note that the steady-state amplitude of self- 
sustained oscillations does not depend on the initial conditions. If 
V 0 = 0, then, in accord with (14.71), the amplitude V(t) is zero for 
any t > 0. However, since at a > 0 the state of small oscillations is 
unstable, the self-excitation of the oscillator will always take place 
with any value of V 0 , however small, arising, say, from thermal 

noise. 

Lastly, it is to be noted that with increasing Q-factor of the 


The difference between 
active and passive 
oscillatory systems 
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tank, when R tends to zero, the parameter a increases, too. This, in 
turn, implies that the transition to a steady-state amplitude 
proceeds faster at higher values of the tank Q (see Eq. (14.71)). It is 
useful to recollect that the passive narrowband systems studied in 
Chap. 9 have diametrically opposite properties. In their case, given 
a nonsteady process, the envelope varies progressively more slowly 
as the Q of the system is increased. 

The phase-plane method. In radio engineering and radio 
physics, a special graphic method is used to describe and interpret 
the behaviour of oscillatory systems, notably oscillators. It is known 
as the phase plane method (or phase plane analysis). The rationale of 
the method can best be explained by taking the already studied 
2nd-order linear oscillatory system as an example. 

Free oscillations in the system are described by the equation 

d 2 x/dt 2 + 2a dx/dt + co(;x = 0 (14.73) 

where the unknown function x may be a voltage, a current, etc. 
From the theory of differential equations it is known that by 
specifying x and dx/dt at any instant, we can fully describe the 
subsequent run of the process in the system. The graphical 
representation of the process will be the motion of a representative 
point along a curve (a phase trajectory) lying in the Cartesian x, 
x'-plane. This plane is called the phase plane of the system. 
^ For each set of initial conditions x and x! there is only one 

The phase portrait phase trajectory. If we take many different values of initial 
conditions, we will obtain an infinite number of nonintersecting 
phase trajectories which together form what is known as the phase 
portrait of the system. 

The phase trajectories for Eq. (14.73) are fairly simple to 
construct because we know the general solution 

x (t) = A exp (- a t) cos (co n t + cp) 

where A and cp are the c onstants dependent on the choice of the 
initial conditions; co n = j/oog - a 2 is the natural frequency. For 
a«co 0 , we approximately have 

dx/dt •a — co n zlexp( — at) sin (a> n t + cp) 

It is convenient to introduce the variable y = (dx/dt)/co n . Then 
the oscillatory process in the system will be represented by two 
time-dependent projections of the representative point on the x- 
and the y-axes: 

x(t) = zlexp( — at)cos(co n t + cp) 

(14.74) 

y(t) = — A exp( — at)sin(co n t + cp) 

It is easy to see that Eqs. (14.74) describe a logarithmic spiral 
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whose radius vector exponentially decreases in time as Aexp( - at), 
if a > 0 (the process is decaying). The representative point moves 
clockwise; the polar angle of the vector, -co n t-cp, varies linearly 
with time. With t tending to infinity, the representative point spirals 
towards the origin, which corresponds to a state of stable 
equilibrium. 

If a < 0 (the process is building up), the phase trajectory spirals 
away from the origin, and this is an indication that the system is in 
a state of unstable equilibrium. 

Finally, if a = 0 (there is neither a build-up nor a decay of the 
process), then in our idealized system the representative point will 
be continuously moving round a circle whose radius depends on 
the choice of the initial conditions. 

Phase portraits of oscillators. Plotting phase trajectories for 
a nonlinear equation of the form in (14.58) which describes an 
oscillator may prove an extremely tedious problem solvable only by 
numerical or graphical methods. If, however, the Q-factor of the 
oscillator tank is high and the oscillations generated are close in 
waveform to harmonic, we will see that the phase plane contains 
a closed curve called a limit cycle, around which the representative 
point moves in the steady state. The radius of the limit cycle is 
equal to the amplitude of steady-state self-sustained oscillations and 
does not depend on the initial conditions. 

Limit cycles may be stable and unstable. An oscillator operating 
in the soft self-excitation mode has only one limit cycle which is 
stable. To demonstrate, if initially the amplitude of oscillations is 
greater than its steady-state value, then, as time passes, the phase 
trajectory will spiral towards the limit cycle. By the same token, the 
amplitude of oscillations will build up if initially it was smaller than 
the value corresponding to the fadius of the limit cycle. 

The situation is more complicated for an oscillator with hard 
self-excitation. Now there are two limit cycles, 1 and 2, of which 
cycle 1 has a smaller amplitude and is unstable while cycle 2 is 
stable. If initially the representative point is inside cycle 1, the phase 
trajectory will spiral towards the origin. Therefore, some external 
force is needed in order to excite the oscillator. If, on the other 
hand, the representative point is located Outside the unstable limit 
cycle I, the phase trajectory will spiral towards the stable limit 
cycle 2. 



The limit cycle 




The hard mode 


Summary 

00- Feedback is widely used to build dynamic systems which will have a specified fre¬ 
quency or impulse response. 

00 There may be positive-feedback and negative-feedback systems. 
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W T1 f. “ s , e of negative feedback in an amplifier makes it possible to build systems with 
a highly stable gain. 

<X> Negative feedback minimizes the nonlinear distortion arising from the nonlinear 

. . current-voltage characteristics of active elements. 

vO Negative feedback makes it possible to expand the bandwidth of an amplifier owing 
to a decrease in the gain level. 6 

W The stability of small oscillations in feedback systems is analysed with the aid 
of stability criteria. Most frequently, these are the Routh-Hurwitz and Nyquist cri¬ 
teria. n 

aa ™?, tive RC filters are fre quency-selective devices containing no inductive elements. 

w When positive feedback is applied to an amplifier, instability may arise. If the circuit 
contains an oscillatoiy system (a tank circuit), an unstable positive-feedback amplifier 
becomes a harmonic oscillator. 

Where the objective is to generate low-frequency harmonic oscillations, resort is ma¬ 
de to RC phase-shift oscillators which do not contain any resonant (tank) cir- 
cults. v ' 

00 In an oscillator the steady-state amplitude of oscillations is decided by the form of the 

A nonlinearity displayed by its electron device. 

W Oscillators may reside in a stable and an unstable steady state. Also, they may operate 
with hard and soft self-excitation. J P 

Review Questions 

1. Formulate the principle by which feedback is classified in dynamic systems. Is it possible 

that in one and the same system feedback is positive at one frequency, and negative at 
some other? 5 

2. List some of the engineering applications of negative feedback in amplifiers. 

3 feedback ? thC featUFe ° f the frequency res Ponse of an amplifier using delayed 

4. Formulate the Routh-Hurwitz and Nyquist stability criteria. 

5. List the most important properties of operational amplifiers. 

6. Why is it that the connection of the output in an operational amplifier to its 
nonmverting input disturbs its stability? 

7. Draw schematic diagrams for the scale changer and the analog integrator built around 
an opamp. 

8. There is a breadboard version of a transformer-coupled oscillator. The oscillator fails to 
be excited although it has been assembled from the components known to be good. 
How would you proceed with the alignment of the oscillator? 

9. Draw schematic diagrams for the Hartley and Colpitts oscillators. 

10. Does the frequency of the oscillations generated by an RC oscillator depend on the gain 
constant of the active element? g 

J!' 1 i s the condition of oscillation for an internal-feedback oscillator? 

12. Define the mean transconductance of an electron device. 

13 oscillator^ fundamental difference between the soft and hard self-excitation of an 

14. If the current-voltage characteristic of a nonlinear active element is known, how can vou 
determine the boundary between the soft and hard modes of self-excitation? 
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Problems 

1. In a feedback system, the forward-path 
element has a frequency-independent gain 
K 0 = 1000. The gain of the feedback loop 
(feedback ratio) is 

Po = 5 x 10 -4 exp(—_/45°) 

Determine what kind of feedback, positive 
or negative, exists in the system. 

2. An amplifier has a frequency- 
independent gain of K 0 = 10000. When the 
ambient conditions (say, the temperature) 
change, the gain changes too, such that 
AK o /K o = 0.2. The system parameters are 
stabilized by negative feedback. Find the 
value of the feedback ratio p for which the 
instability in the gain is reduced by a factor 
of 10, that is, to AKfl/Kfb = 0.02. What is 
the closed-loop (overall) gain of the system 
in the circumstances? 

3. Demonstrate that in the amplifier 
shown in the accompanying diagram 



there is negative feedback such that 

P° = - Rfb/RL 

Hint : Use an auxiliary voltage v between 
the base and the emitter (see the diagram) 
and note that the a. c. component of 
emitter current is 

*E = Qm v 

4. Find the voltage-ratio transfer function 
£ = "outMn 

of the emitter follower shown in the 
accompanying diagram: 



Hint : The transconductance g m of the 
transistor should be assumed known. 

5. In a single-stage RC-loaded amplifier, 
Rl= 1.6 k£l The stray capacitance C s in the 
collector lead is 50 pF. The trans¬ 
conductance of the transistor is g m = 
= 30 mA/V. The emitter lead contains 
a feedback resistor Rfb = 27 Q (see Problem 
3). Find the upper and lower cut-off fre¬ 
quencies of the amplifier with and without 
negative feedback. 

6. Using the Routh-Hurwitz criterion, 
analyse the stability of small oscillations in 
a dynamic system described by the 
characteristic equation: 

(a) p 4 + 3p 3 + 2p 2 + p + 1 = 0 

(b) p 4 + 2p 3 + 3p 2 + p + 1 = 0 

7. Using the Nyquist criterion, analyse 
a delayed-feedback system (see Fig. 14.4) for 
stability. 

8. Using the Nyquist criterion, analyse for 
stability the closed-loop system containing 
two ideal amplifiers each of gain K 0 : 



9. Find the transfer function of the system 
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shown below: 


*2 



10. An analog integrator built around an 
opamp (see Fig. 14.9) has the following 
parameters: R = 2.7 kQ, C=1.8 nF. The 
opamp draws its power from a power 
supply with F SU p= 12 V. The signal applied 
to the integrator input is v m = 0.1a(t). Find 
the output signal and determine the time 
required for the output voltage to reach the 
supply voltage level. 

11. Synthesize a second-order Chebyshev 
active RC low-pass filter, the initial 
specifications being co c = 1.5 x 10 2 s~ 1 and 
8 = 0.75. 

12. The transformer-coupled oscillator of 
Fig. 14.12 uses a tank circuit tuned to / res = 
= 400 kHz. The element values of the tank 
are L=15pH and R = 8 Q. The dynamic 
transconductance of the transistor is gd = 
= 1.5 mA/V. Find the critical value of 
mutual inductance M assuring the 
self-excitation of the system. 

13. The RC oscillator of Fig. 14.14 
generates harmonic oscillations at 250 Hz. 
Select the element values necessary for the 
oscillator to operate at the frequency stated, 
assuming that the oscillator is operating at 
the boundary of excitation. 

14. The current-voltage characteristic of 
a transistor is approximated by two straight¬ 


line segments: 



Construct a plot of the mean transcond¬ 
uctance 0 mi as a function of the amplitude 
of the high-frequency voltage V, assuming 
that the operating point is at V 0 = 0.75 V. 

15. The harmonic oscillator shown 
schematically in the accompanying diagram 



uses a transistor whose characteristic is 
given in Problem 14. The circuit parameters 
are co 0 = 10 6 s " \ Q = 50, M = 0.2 pH, and 
V 0 = 0.75 V. Find the steady-state amplitude 
of oscillations. Construct approximate plots 
of the steady-state amplitude as a function 
of the mutual inductance and the bias 
voltage. 

16. In the oscillator of the previous 
problem the initial bias is set at 0.25 V. 
Show that the system will operate with hard 
self-excitation. Find M at which the 
steady-state amplitude of oscillations is 1 V. 
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Advanced Problems 

17. Show that the feedback system in 
Fig. 14.1 can be described by an infinite 
relation of the form 

bout = KV'm 

+ P (K F in + P (K Fin + P (K Fin + • ■ • 

relating the Laplace transforms of the input 
and output signals. Inquire into the 
equivalence between the above 
representation and Eq. (14.2). Discuss the 
treatment of the processes in a feedback 
system as the circulation of signals round 
the feedback loop. 

18. Plot the Nyquist locus and, using the 
Nyquist stability criterion, investigate the 
stability of a three-stage FC-coupled 
amplifier, assuming that the output of the 
system is directly connected to the input. 

19. Investigate the condition of 
self-excitation for a RC phase-shift oscillator 
set up as shown in the accompanying 
diagram: 



Derive an expression for the frequency of 
oscillation, neglecting the effect of the gain 
of the active element on the imaginary part 
of the roots of the characteristic equation. 

20. Analyse the steady-state amplitude of 
oscillations in a distributed-parameter 
oscillatory system, assuming that the per- 
unit-length shunt conductance which 
describes the effect of the active medium is 
defined by 

G i = — 0i + <xF 2 

where 0 X and a are constants, and V is the 
amplitude of h.f. oscillations. 

21. Show that the transfer function of 
a bandpass filter is realized by the circuit of 
the form shown below: 








































































Chapter 15 

Discrete Signals. 

Principles of Digital Filtering 

The difference between discrete and continuous (analog) signals 
has been underlined in Chapter 1 when considering the 
classification of signals. It is worth while to recollect the basic 
property of a discrete signal: Its values are defined at a countable 
set of points (..., t 0 , t l9 t 2 , ...) rather than for all instants of time. 
Therefore whereas an analog signal x(t) is represented by 
a mathematical model possessing the usual properties of a smooth 
function, a discrete signal xa(0 is described by a series (..., x 0 , x l9 
x 2 , ...) of its values at points (..., t 0 , t l9 t 2 , ...), respectively. 

Discrete signals arise naturally in cases where a message source 
generates information at fixed instants of time. Typical discrete 
signals are the air temperature data transmitted by broadcasting 
stations several times a day. The salient feature of discrete signals is 
displayed here with utmost clarity: Between the broadcasts there is 
no information available about the quantity involved, although the 
air temperature is changing all the time in a quite gradual manner. 
Thus, the measured data are the outcomes of a special procedure 
by which a continuous quantity is converted into a series of discrete 
values. This procedure is called sampling, and the data thus 
generated are the samples of a continuous signal. 

Discrete signals have come to the fore in recent decades in the 
wake of advances in communications engineering and in data 
processing on high-speed computers. As a corollary, specialized 
computing devices have been developed, specifically adapted to 
process digital information and known as digital filters. 

This chapter will be concerned with the principles underlying 
a mathematical description of discrete signals and the theoretical 
foundations on which the synthesis of devices for digital data 
processing is based. 

15.1 Discrete Pulse Sequences 

For the first time discrete signals came into use in the 1940s with 
the advent of pulse-modulated communication systems. A salient 
feature of pulse modulation is the fact that the carrier is a periodic 
train of short pulses rather than a continuous harmonic wave. 

Principle of pulse modulation. Consider the simple pulse 
modulator shown in block-diagram form in Fig. 15.1. 

Referring to the figure, the pulse modulator is a device with two 
inputs. One input accepts the original analog signal x(t) to be 
sampled. The other input is fed a periodic train of short 
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X(t) 

Pulse 

/d(0 


X 

modulator 


x d 

r\_/ 

i 

\ 


Sync pulse 



0 

generator 

0 


t 


Fig. 15.1 Block diagram of a pulse modulator 


synchronizing (sync) pulses equidistantly spaced in time, the spacing 
A being known as the sampling interval. The modulator is arranged 
so that each time a sync pulse is applied, the instantaneous value of 
x(t) is measured, or sampled, and a short pulse whose area is 
proportional to the sample, appears at the output of the device. 

From the above principle, we may write the following 
mathematical model for the discrete, or sampled, waveform 
produced by pulse modulation: 

00 

x d (t) = £ x (/cA) 8(t — kA) (15.1) 

k= — oo 


It is to be noted that from a formal mathematical point of view 
the shape of the pulses that make up the output signal is entirely 
immaterial. For example, these pulses may all be of the same 
duration while their amplitude varies in proportion to the 
instantaneous values of the original waveform at the sampling 
points. This form of modulation has come to be known as pulse- 
amplitude modulation (PAM for short). There is another procedure 
called pulse-width, pulse-duration or pulse-length modulation, 
(abbreviated PWM, PDM or PLM), in which the output pulses are 
of a constant amplitude, but their width (duration or length) is 
directly proportional to the instantaneous values of the analog 
signal. 

The choice of a particular form of pulse modulation is dictated 
by engineering considerations (ease of physical implementation) and 
by the character of the signals being transmitted. For example, the 
use of PAM may be unwarranted if the original modulating signal 
varies between broad limits or, as is usually said, it has a broad 
dynamic range. The point is that a faithful transmission of such 
a signal would require a transmitter in which a rigorously linear 
relationship is maintained between the amplitudes of the input and 
output signals. This constraint is nonexistent in PWM systems, but 
they are more difficult to implement engineeringly than PAM 
system. 


The sampling interval 


With this model, the 
values of the signal 
between sampling in¬ 
stants are assumed to 
be zero 


PAM 


1 1 0 n * 
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Use of PM systems 


The sampling sequence 


n 


_ t_ 

-A 0 A 


The spectrum of the 
sampling sequence 


As already noted in Chap. 1, the most important use for pulse 
modulation is in time-division-multiplex (TDM) communication 
systems. 

A further advantage of pulse modulation is that it assures a high¬ 
er noise immunity as compared with the cases where the carrier is 
a simple harmonic wave. 

The spectrum of a digitized (sampled) waveform. Let us look into 
the spectrum transformation that takes place when an arbitrary 
analog signal is sampled. To this end, we refer to Eq. (15.1) and 
note that the digitized (sampled) signal xd(t) is the product of the 
original wave x(t) and the so-called sampling sequence 

00 

*1(0= . X 6(t-*A) (15.2) 

k— — oo 

formed by delta impulses following at equal time intervals A. As 
will be recalled, the spectrum of the product of two signals is the 
convolution of their individual spectra (see Chap. 2). Therefore, 
since we know how the signals and their spectra are related to one 
another: x(t)<-+S x ( co) and rj (t^S^ (oo), we may conclude on the 
basis of Eq. (2.35) that the spectrum of the sampled waveform, 
S x d(co), is equal to 

1 00 

^xd(©) = - J Sr\ (co)Sx(co — £)d^ (15.3) 

— oo 

In order to find the spectrum of the sampling sequence, 5 T1 (co), 
we expand the periodic function r| (r) into a Fourier series: 

00 

T| (t) = X C » ex P (/ 2nnt/A) 

n= — oo 

The coefficients of the series (the Fourier coefficients) are given by 
! a/2 

C n = —— f d(t)exp(-j2nnt/A)dt= 1/A 
A _a/2 

Referring to Eq. (2.42), we get 
2n ® 

5n (©) = —— £ 8 (co — 2nn/A) (15.4) 

A n— — oo 

That is, the spectrum of the sampling sequence consists of an 
infinite series of delta impulses displaced along the frequency axis 
so that they are separated by an interval equal to 2 tc/A(s - 1 ). 
Finally, on substituting (15.4) into (15.3) and reversing the order 
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of summation and integration, we get 


i °° 

Sxd(a») = — X S x ((o-2nn/A) (15.5) 

A n = — oo 


Thus, the spectrum of the sampled waveform consists of an infinite 

succession of repetitions of the spectrum of the original waveform 

(to within the negligible scale factor 1/A). These repetitions are ^ 

displaced along the frequency axis so that they are separated by the Soive p ro bl e m 1 

interval 2n/A, equal to the angular sampling rate (Fig. 15.2). 



Fig. 15.2 Spectra (green areas) of the sampled waveform for two values of 
the upper frequency limit in the signal spectrum: (a) upper frequency limit 
exceeds half the sampling rate; ( b ) upper frequency limit is less than half the 
sampling rate 


The reconstruction of a continuous waveform from a sampled 
waveform. If co u is the upper frequency limit in the spectrum of the 
original waveform, then, as can be seen from Fig. 15.2, for co u < 
<; jt/A, the individual lobes of the spectral diagram do not overlap 
any longer. Therefore, it is possible to reconstruct the original 
continuous waveform by passing the sampled waveform defined in 
(15.1) through a low-pass filter. The maximum allowable sampling 
interval will then be A = 7t/(0u = 1/2/u, which completely agrees with 
the sampling theorem. 

Let the filter used to reconstitute the original continuous 
waveform have the frequency response function 


K (/©)=• 


0, 

K, 

0, 


o> 


© < — © u 
— © u < © < ©u 


% 15 * 


© > ©u 
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Part Two. Circuits 


The amplitude factor 
has been chosen to 
make the result more 
instructive 


The reconstruction fil¬ 
ter may be a high- 
order Butterworth low- 
pass filter 


Its impulse response is then 

1 00 

h(t) = — I K {j a) exp {jot) dm = (K 0 (o u /n) sin {(o u t)/(o u t 

471 — oo 


On setting K 0 = n/a u and noting that the sampled waveform 
defined in (15.1) is the weighted sum of delta impulses, the 
waveform at the output of the reconstituting filter is found to be 


y(t) = 


Z x(kA) sinm »( f -*”/<»°) 
k=- oo C0 U (t ~ k 7t/C0 u ) 


(15.6) 


which, in accord with (5.18), is an exact repetition of the original 
bandwidth-limited waveform x(t). 

An ideal low-pass filter is not physically realizable and can only 
serve as a theoretical model with which we can explain the 
principle of reconstituting a continuous waveform (the original 
message) from its discrete samples, or the sampled waveform. A real 
low-pass filter has an amplitude (magnitude) response which either 
encompasses several lobes of the spectral diagram or is 
concentrated near the zero frequency and is substantially narrower 
than, the central lobe. As an example, Fig. 15.3 shows waveforms 
illustrating the reconstruction of a sampled signal by means of an 
RC network. As seen, a real reconstruction low-pass filter inevitably 
distorts the original waveform. 

It is to be noted that signal reconstruction could utilize not only 


x d 
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Fig. 15.3 Reconstruction of a continuous waveform from its samples with 
an RC-network: (a) filter schematic; ( b ) sampled waveform; (c and d) 
amplitude response of the filter and the signal at its output for RC» A; (e 
and /) same for RC« A 
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the central, but any side lobe of the spectral diagram. In addition to 
low-pass filtering, however, this would necessitate resort to fre¬ 
quency transformation or synchronous detection. 

15.2 Digitization of Periodic Signals 

In signal analysis by computers, the following situation is typical: 
A continuous signal x(t) is specified over a time interval (0, T ) by 
its sampled values (x 0 , x l9 x# _ i) taken respectively at times (0, 
A,..., (N — 1) A); the total number of sampled values is N = T/A. The 
collection of these numbers, real or complex, is the only 
information from which we can judge about the spectral properties 
of the signal x(t). The procedure by which such discrete signals are 
analysed consists in that the collection of sampled values is 
repeated mentally an infinite number of times. As a result, the 
signal becomes periodic (Fig. 15.4). 



Fig. 15.4 Sampled representation of a periodic signal 

On assigning to this signal a particular mathematical model, we 
can use an expansion into a Fourier series and find the 
corresponding amplitude (Fourier) coefficients. The collection of 
these coefficients forms the spectrum of the periodic discrete signal. 

The discrete Fourier transform. Let us use a model in the form of 
a series of delta impulses and assign to the original waveform x(£) 
its discrete representation on the inverval (0, T ): 

N -1 

x d (t)= I x k d(t-kA) (15.7) 

k = 0 

where Xk = x(k A) are the sampled values at the k th points. 

Now we represent the discrete model in (15.7) by a complex 
Fourier series 

00 

xd (£) = Y, C n cxp{j2nnt/T) (15.8) 

n= — oo 

in which the Fourier coefficients are defined as 
1 7 

C n = — J Xd (t) exp (— j 2nnt/T)dt (15.9) 

T o 


The samples shown in 
colour belong to the 
periodicity interval 
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Part Two. Circuits 


▲ 

Solve Problem 2 


m 

Properties of the dis¬ 
crete Fourier trans¬ 
form (DFT) 


On substituting (15.7) into (15.9) and introducing a dimensionless 
variable £, = t/ A, we obtain 
j NAN-1 

C„ = —— J £ Xfc8(( - fcA)exp( —j2nnt/T)dt 

^ & 0 fc = 0 

. N N — 1 

= —J X x*8(5-fc)exp(-.?2jcnS/JV)d5 

-W 0 fc = 0 
I N — 1 N 

= TT Z xfc J 8(^-/c)exp(-j27tn^/iV)d2, 

^ k= 0 0 

Finally, by utilizing the filtering properties of the delta-function, 
we have 


Cn ~ N 


N - 1 


Z x/j exp ( — j 2nnk/N) 

k = 0 


(15.10) 


Equation (15.10) defines the series of coefficients which form the 
discrete Fourier transform (DFT) of the signal. This transform has 
the following obvious properties. 

1. The discrete Fourier transform is a linear transform, that is, 
a sum of signals can be represented by the sum of their individual 
discrete Fourier transforms. 

2. The number of Fourier coefficients C 0 , C l9 ..., found 

by Eq. (15.10) is equal to the number N of sampled values in the 
collection. Thus, for n = N, Cn = C 0 . 

3. The coefficient C 0 (the constant component) is the mean value 
of all sampled values: 

N — l 

= £ Xk 
iV fc = 0 

4. If the number N of samples is even, then 

, N — l 

C N/2 = — X Xk(-\) k 
™ k = o 

5. If the sampled values xk are real numbers, then the Fourier 
coefficients located symmetrically about N/2 form complex 
conjugate pairs: 

I N—l 

Cjv-n = — X x k ex P [ -fin(N - n)k/N] 

FI k = 0 

| N — 1 

= ~rr Z x k ex P (jlnnk/N) = C$ 

k= 0 
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Therefore it is legitimate to think that the coefficients Cn/ 2 + i»---* 
Cjv-i correspond to negative frequencies. In the analysis of the 
amplitude spectrum of a signal they do not play any role, so they 
need not be calculated. 


Example 15.1. Over its periodicity interval a sampled signal is 
specified by six equidistant samples {x/J = (1, 1, 1, 0, 0, 0). Find the 
coefficients of the discrete Fourier transform for this signal. 

Using Eq. (15.10), we directly calculate: 

3 

C 0 = — = 0.5 
o 

Cj = i(l + 1 X e~ jn/3 + 1 X e-f^ * 1 2 3 4 5 ) = 1(1 -j]/3) 

C 2 =—{\ + 1 x e~ j2K/3 +l x e ~j 4l1 / 3 ) = o 
6 

C 3 = T(l + e' K + e i2K ) = T 
o o 

The remaining coefficients are found on the basis of their 
conjugacy: 

c 4 = C* = 0, C 5 = C* = T (1 +;•]/3) 

The number of harmo- Thus, since we have a sampled signal with N = 6 samples, we can 
nics being found find the^constant component and the complex amplitudes of the 

fundamental, the second and third harmonics of the original 
continuous waveform. Clearly, with any even number N, the 
number of harmonics thus found account for half the sampled 
values. This stems directly from the Kotelnikov sampling theorem. 
To demonstrate, the upper frequency limit in the spectrum of the 
sampled waveform is f u = 1/(2A) = (N/2)f l9 where f 1 = \/T is the 
fundamental frequency. 

The reconstruction of the original waveform from its discrete 
Fourier transform. Once the discrete Fourier coefficients (C 0 , C l9 
C 2 , . Cn/ 2 ) h ave been found from the collection of samples (x 0 , 

*!,..., Xjv-i) °f a real signal, we can always reconstruct from them 
the original waveform x(t). Obviously, the Fourier series of such 
a signal takes the form of a finite sum 

x(t) = C 0 + 21 C l | cos(2tU/T+ cpj_) -b 21 C 2 \cos(4nt/T+ cp 2 ) 

+ ... | C///2 I COS (2V 7ur/7" + (Pn/ 2 ) (15.11) 


It is assumed in ad¬ 
vance that the original 
signal satisfies the con¬ 
ditions of the Kotelni¬ 
kov (sampling) theo¬ 
rem 
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Fig. 15.5 Signal reconstituted from discrete Fourier transform coefficients 

where cp, = argC/ are the phase angles of the corresponding Fourier 
coefficients. As an example, Fig. 15.5 shows a signal x(t) 
reconstructed from its samples in accordance with the data given in 
Example 15.1. On the basis of Eq. (15.11), this signal may be 
defined as 

1 2 1 
x (t) = — + — cos ( 2nt/T- tc/ 3) + — cos (6nt/T) 

A 2 3 o 

Solve Problem 3 it should be especially stressed that the reconstruction of 

a continuous waveform by Eq. (15.11) is not an approximate , but an 
exact operation fully equivalent to obtaining the instantaneous 
values of a band-limited signal from its samples making up the 
Kotelnikov series. In some cases, however, it is preferable to use the 
procedure based on the discrete Fourier transform, because it leads 
to finite sums of harmonics, while the Kotelnikov series for 
a periodic signal must in principle contain an infinite number of 
members. 

The inverse discrete Fourier transform (IDFT). The task of 
discrete spectral analysis may be stated in a different way. Suppose 
that the discrete Fourier coefficients C n are specified in advance. 
Also let us set t = k A in Eq. (15.8) and note that the sum is taken 
only over a finite number of members in the series, which 
correspond to the harmonics contained in the spectrum of the 
original waveform. Hence, we obtain an equation for sampled 
values 


N -1 

Xk= X C n exp(j2nnk/N) (15.12) 

n = 0 


which defines the algorithm of the inverse discrete Fourier transform 
{IDFT). 

The mutually complementing equations (15.10) and (15.12) are 
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the discrete counterparts of the usual Fourier transform pair for 
continuous signals. 

At present, discrete spectral analysis is one of the most widely 
used techniques of numerical analysis of signals on a computer. As 
an example, Appendix 5 gives a FORTRAN subroutine for 
computing the discrete Fourier transform. It should be noted that 
with a large number of sampled values, any direct calculation of the 
sum in (15.10) or (15.12) involves the expenditure of a lot of 
computer time. To avoid this, resort is widely made to what is 
called as the fast Fourier transform (.FFT ). By purely algorithmic 
means, it substantially reduces the amount of computations 
involved in finding coefficients for the discrete Fourier transform 
and the inverse discrete Fourier transform [35]. 

Discrete convolution. By analogy with the conventional 
convolution of two signals 
00 

f(t)= J x{z)y{t-x) dx 

— 00 

we may introduce a discrete convolution which is a signal 
represented by a collection of its sampled values 


fm = Wm - k, m = 0, 1, 2, .... N - 1 (15.13) 

fc = 0 


Let us establish the relation between the coefficients of the 
discrete convolution and the coefficients of the signals x d (0 and 
y d (t). To this end, we express the instantaneous values of the 
coefficients x k and ym—k as the inverse discrete Fourier transforms 
of the corresponding spectra: 


N-l N ~' 

x k = Y C xn exp (jlnnk/N) y m -k= I C^exp [j2nl(m - k)/N] 


n — 0 


1=0 


and substitute them in (15.13): 


/m at X 
M k = 0 


N- l r N-l 

X C xn exp (j2nnk/N) 

n = 0 


N -1 

Z Cyl 


1 = 0 


x exp [/ 2nl (m — k)/N~] j 

On changing the order of summation, we have 
= Z C xn C y iexp(j2nlm/N)x £ exp [j2n(n - l)k/N] 

N n=0 1=0 k ~° 


▲ 

Solve Problem 4 


The fast Fourier trans¬ 
form (FFT) 


(15.14) 
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Fig. 15.5 Signal reconstituted from discrete Fourier transform coefficients 

where cp, = argC* are the phase angles of the corresponding Fourier 
coefficients. As an example, Fig. 15.5 shows a signal x(t) 
reconstructed from its samples in accordance with the data given in 
Example 15.1. On the basis of Eq. (15.11), this signal may be 
defined as 

1 2 1 
x (t) = — + — cos (2 t it/T- n/3) + — cos (6nt/T) 

A 2 3 o 

Solve Problem 3 it should be especially stressed that the reconstruction of 

a continuous waveform by Eq. (15.11) is not an approximate , but an 
exact operation fully equivalent to obtaining the instantaneous 
values of a band-limited signal from its samples making up the 
Kotelnikov series. In some cases, however, it is preferable to use the 
procedure based on the discrete Fourier transform, because it leads 
to finite sums of harmonics, while the Kotelnikov series for 
a periodic signal must in principle contain an infinite number of 
members. 

The inverse discrete Fourier transform (IDFT). The task of 
discrete spectral analysis may be stated in a different way. Suppose 
that the discrete Fourier coefficients C n are specified in advance. 
Also let us set t = k A in Eq. (15.8) and note that the sum is taken 
only over a finite number of members in the series, which 
correspond to the harmonics contained in the spectrum of the 
original waveform. Hence, we obtain an equation for sampled 
values 


N -1 

Xk= X C n exp (jlnnk/N) (15.12) 

n — 0 


which defines the algorithm of the inverse discrete Fourier transform 
{IDFT). 

The mutually complementing equations (15.10) and (15.12) are 
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the discrete counterparts of the usual Fourier transform pair for 
continuous signals. 

At present, discrete spectral analysis is one of the most widely 
used techniques of numerical analysis of signals on a computer. As 
an example, Appendix 5 gives a FORTRAN subroutine for 
computing the discrete Fourier transform. It should be noted that 
with a large number of sampled values, any direct calculation of the 
sum in (15.10) or (15.12) involves the expenditure of a lot of 
computer time. To avoid this, resort is widely made to what is 
called as the fast Fourier transform {FFT). By purely algorithmic 
means, it substantially reduces the amount of computations 
involved in finding coefficients for the discrete Fourier transform 
and the inverse discrete Fourier transform [35]. 

Discrete convolution. By analogy with the conventional 
convolution of two signals 
00 

/(C)= j x(i)y(t-x) dr 

— 00 

we may introduce a discrete convolution which is a signal 
represented by a collection of its sampled values 


fm = 4r N Z x k ym-k,m = 0,l,2,...,N-\ 05.13) 

-W k = 0 


Let us establish the relation between the coefficients of the 
discrete convolution and the coefficients of the signals Xd(t) and 
y d (f). To this end, we express the instantaneous values of the 
coefficients x k and y m -k as the inverse discrete Fourier transforms 

of the corresponding spectra: 

N-\ N-1 

x k = V C xn exp (jlnnk/N) y m -k= I C y ,exp[j2nl{m- k)/JV] 

n = 0 1=0 

and substitute them in (15.13): 


N-l 


f m ~ N £ 

w k = 0 


pN-\ 

£ C xn exp (jlnnk/N) 


n = 0 


N -1 

X Cyl 


1 = 0 


x exp [/ 2nl (m — /c)/N]| 

On changing the order of summation, we have 
f m = T N 'f N Y J ' C xn C y iexp(j2nlm/N)x £ exp [jin(n - l)k/N] 

N n = 0 1 = 0 k ~° 


▲ 

Solve Problem 4 


The fast Fourier trans¬ 
form (FFT) 


(15.14) 
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It is easy to note that the inner sum 


The convolution of pe¬ 
riodic signals pre¬ 
sented here is someti¬ 
mes called cyclic con¬ 
volution 


£ ex P [J2n(n - l)k/N] = { ^’ lf H 1 
k=0 l 0, if n^l 

Here, the upper equality is obvious; the sum vanishes for n^l 
because all terms are complex numbers of unity magnitude and 
with a linearly increasing argument. When they are combined 
vectorially, they always form a regular closed polygon on the 
complex plane. Taking advantage of the above result, we obtain on 
the basis of Eq. (15.14) 


N -1 

f m = £ C xn C yn exp (j2nmn/N) (15.15) 

n = 0 


Since Eq. (15.15) is an inverse discrete Fourier transform, we may 
conclude that the Fourier coefficients of the convolution are the 
products of the discrete Fourier coefficients of the signals being 
convoluted: 

C//c = CxkCyk, k — 0, 1, ..., N — 1 (15.16) 

Apart from establishing a useful analogy between the spectral 
properties of continuous and discrete signals, the above result is of 
importance for the theory of discrete signals and digital filters. The 
point is that if the number of sampled values is very large (say, 
several thousand), then, in finding the convolution of signals, one 
should first find their discrete Fourier transforms, then multiply the 
coefficients, and finally use Eq. (15.15) and the fast Fourier 
transform. This procedure is often more economical than the direct 
use of Eq. (15.13). 

15.3 The Theory of the z-Transform 

The z-transform is widely used in the analysis and synthesis of 
sampled-data systems. It has the same relationship to discrete (or, 
rather, sampled) signals as the integral Fourier and Laplace 
transformations bear to continuous signals. This section will set 
forth the basic theoretical aspects of the z-transform related to the 
properties of this functional transformation. 

Definition of the z-transform. Let {xk}=(x 0 , x l9 x 2 , •••) be 
a numerical sequence, finite or infinite, which contains the sampled 
values of a signal. We place this sequence in a one-to-one 
correspondence with a sum of an inverse power series of the 
complex variable z: 

00 

X(z) = x 0 + x 1 /z + x 2 /z 2 + ...= Y, Xkz~ k 

k= o 


(15.17) 
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This sum, if it exists, is called the z-transform of the sequence 
{xk}- The introduction of this mathematical concept is warranted 
because the properties of discrete sequences of numbers can 
conveniently be analysed by investigating their z-transforms with 
the usual techniques of mathematical analysis. 

On the basis of Eq. (15.17) we directly derive z-transforms for 
sampled signals with a finite number of sampled values. Thus the 
simplest sampled signal with a single sampled value, {xk} = 
= (1,0,0,...), corresponds to X(z)= 1. If, for example, {xfc} = 
= (1, 1, 1, 0, 0, 0,...), then 

X(z)=\ + 1/z + 1/z 2 = (z 2 + z+ 1 )/z 2 

Convergence of the series. If the series defined in (15.17) contains 
an infinite number of members with nonzero coefficients, we should 
inquire into the convergence of the series. From the theory of 
functions of a complex variable [11] the following is known. Let 
the coefficients of the series in question satisfy the condition 

\x k \<MR k 0 (15.18) 

for any k ^ 0. Here, M > 0 and R 0 > 0 are constant real numbers. 
Then the series (15.17) converges for any z such that \z\>R 0 . In 
this region of convergence, the sum of the series is an analytic 
function of the variable z, having neither poles nor substantially 
singular points. 

As an example, consider a sampled signal {xk} = { 1, 1, 1, •••) 
formed by identical samples of value unity and serving as a model 
for the usual switching function. The infinite series 

X(z) = 1 + 1/z + 1/z 2 + ... 

is the sum of a geometric progression and it converges for any 
z inside the domain | z | > 1. On taking the sum of the progression, 
we get 

X (z) = 1/(1 — 1/z) = z/(z — 1) 

At the boundary of analyticity, this function has only one simple 
pole for z = 1. 

Acting similarly, we derive the z-transform of an infinite sampled 
signal of the form 

{Xk} == (1 > ^5 ^ 5 * * * ) 

where a is some real number. Then 


In mathematics, the z- 
transform is also called 
the generating function 
of the original se¬ 
quence 


▲ 

Solve Problem 5 


X (z) = 1 = z/(z - a) 

1 — a/z 

with the series converging and with the expansion having any 
meaning only inside the domain \z\> a. 
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The z-transform of continuous functions. Assuming that {x k } are 
the sampled values of the continuous function x(t) at the sampling 
Solve Problem 6 instants t = kA , we can assign to any signal x(t) its z-transform 

with a suitably selected sampling interval: 

X(z)= f ]x(kX)z- k (15.19) 

fc= 0 


For example, if x (t) = exp (at), then the corresponding z-transform 


X(z)= £ exp(a/cA)z k 
k = o 


z 

z — exp (aA) 


is an analytic function for | z | > exp (aA). 

The inverse z-transform. Let X (z) be a function of the complex 
variable z, analytic inside the circle \z\> R 0 . A distinction of the 
z-transform is that the function X(z) possessing this property 
defines all of the infinite set of sampled coefficients (x 0 , x l5 x 2 , ...). 

To demonstrate, we multiply both sides of Eq. (15.17) by z m_1 : 


The integration con¬ 
tour is traversed in 
the positive, that is, 
counterclockwise di¬ 
rection 


z m 1 X(z) = x 0 z m 1 + x 1 z m 2 + ... + x m z~ l + ... (15.20) 

then evaluate the integrals of the both sides of the above equality, 
choosing as the contour of integration a closed path wholly lying in 
the analyticity region and enclosing all the poles of the function 
X(z). In doing so, we take advantage of the fundamental fact 
stemming from Cauchy’s theorem: 



2nj, 

0, 


if n = — 1 
if M — 1 


Then the integrals of all terms on the right-hand side, except the 
mth term, will vanish, and so 


The inverse z-trans- 
form 



m - i 


X (z) dz 


Equation (15.21) is known as the inverse z-transform. 


Example 15.2. Given: The z-transform 
X (z) = (z + l)/z 

To find: The coefficients of the sampled signal answering the above 
function. 

To begin with, we note that X (z) is analytic over the entire plane, 
except the point z = 0, and so there may exist a z-transform of 
some sampled (discrete) signal. 


(15.21) 
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▲ 

Solve Problem 7 


X 0 = 


X, =- 


2nj 

1 

2nj 


1 hz + 1 


O 


z 

z+ 1 


-dz = 1 


dz = 1 


z 

,m-2 t 


(z ~ 1)dz=0 

for any m ^ 2. Thus, the sampled signal in question has the form (1, 

1 , 0 , 0 , 0 , ...). 


Relation to the Laplace and Fourier transforms. Let us define for 
t^Oa sampled (discrete) signal in the form of an ideal pulse train: 

00 

*dM= £xfc8(£-/cA) 

k= 0 


Its Laplace transform is 

00 

F(P)= I x k exp(-pkA) (15.22) 

k = 0 


which directly goes into the z-transform if we set z = exp(p A). If, on 
the other hand, we put z = exp(/coA), the expression 

00 

5(co)= £ x k exp( -j&kA) (15.23) 

*=o 


will be the Fourier transform of the pulse train. 

The relation we have just established plays an important role and 
permits us to draw certain analogies between the properties of 
continuous and discrete (sampled) signals. 

The most important properties of the z-transform. 

1. Linearity. If {x^} and {y k } are two numeric sequences 
representing some sampled signals whose z-transforms X (z) and 
Y(z) are known, then the signal {uk} = {otxk + P yk} corresponds to 
the transform U (z) = aX (z) + p7(z) for any constants a and p. This 
is proved by substituting the sum in Eq. (15.17). 

2. The z-transform of a time-shifted signal. Consider a sampled 
signal {yk} obtained by shifting {x&} backward by one position 
(one sampling interval) such that y k = xk- x . By directly evaluating 
the z-transform, we get 

00 oo 

Y(z)= £ x k-iZ~ k =z~ 1 Y. x n z~ n =^ z~ 1 X(z) 

k =0 n =0 


The properties listed 
here are directly ana¬ 
logous to those of the 
Fourier and Laplace 
transforms of analog 
signals 


(15.24) 
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* 

The unit delay opera¬ 
tor 


In contrast to the 
circular convolution, it 
is sometimes called the 
linear convolution 


# 

Properties of the 
discrete convolution 


The analog-to-digital 
converter 


It is to be noted that z 1 is the unit delay operator (a delay by one 
sampling interval) in the z-domain. 

3. The z-transform of a convolution. Let x(t) and y(t) be 
continuous signals for which the convolution function is 

00 00 

f(t)= j x(x)y(f-x)dx = J y(x)x(t-x)dx (15.25) 

-00 -00 

By analogy with Eq. (15.25), for sampled signals we introduce 
a discrete convolution {f k } which is a series of numbers the 
common term of which is 

00 00 

fm= £ x k y m -k= £ ykXm-k, m = 0,1, 2,... (15.26) 

k =0 k=0 

Let us take the z-transform of a discrete convolution: 

00 00 00 00 

F(z)= £ £ x k y m -kz~ m = £ £ x k z- k y m _ k z~^ 

m = 0 k=0 m = 0k=0 

00 00 

= k J, x k z ~ k n £ 0 yn " = X (z) Y(z) (15.27) 

Thus, the convolution of two sampled signals corresponds to the 
product of their z-transforms. 


15.4 Digital Filters 

At present, communication signals are frequently processed with 
the aid of microcomputers and microcomputer systems. This 
section deals with the simplest and best known class of systems for 
digital signal processing known as linear stationary digital filters. 
Performing, similarly to analog circuits, the operation of frequency 
filtering, digital filters offer a number of important advantages. 
Among other things, this includes the high parameter stability and 
the choice of an extremely wide variety of shapes for the amplitude 
and phase responses. Digital filters need no alignment and tuning, 
and can readily be implemented in the form of computer algorithms 
and programs. 

The principle of digital signal processing. A basic block diagram 
for digital signal processing is shown in Fig. 15.6. 

A continuous input signal x(t) is fed to an analog-to-digital 
converter, ADC, controlled by sync pulses from a special generator 
which maintains the desired sampling rate. Each time a sync pulse 
is applied, the ADC delivers at its output a signal representing the 
instantaneous value of the input wave in the form of a binary 
number with a fixed number of digit (bit) positions. Depending on 


Ch. 15 Principles of Digital Filtering 


463 



Fig. 15.6 Block diagram of a set-up for digital processing of continuous 
signals 


the particular arrangement of the digital filter, this number may 
correspond to a train of short pulses (when the transmission is in 
a sequential code) or to a set of voltage levels at the signal lines of 
the individual bit positions (when the transmission is in a parallel 
code). Thus transformed, the signal is fed to the main unit of the 
system, called the digital signal processor consisting of an arithmetic 
unit and a memory (or storage) unit. The arithmetic unit performs 
on numbers a range of operations such as multiplication, addition, 
and a time shift through a specified number of sampling intervals. 
The memory unit may store a number of previous sampled values 
of the input and output signals, which may be utilized in the course 
of signal processing. 

The digital processor handles the incoming numbers as 
prescribed by a filtering algorithm and produces at its output 
a sequence of binary numbers representing the output signal. If the 
end user needs data in analog form, the number sequence is 
additionally passed through a digital-to-analog converter, DAC. 
However, a digital filter may contain no DAC, if the output signal 
is only to be subjected to digital processing. 

The performance of a digital filter is judged in terms of its speed 
which depends on the rate of transients in the circuit components 
and on the complexity of the filtering algorithm. 

In the early 70s the frequency limit for the signals processed by 
digital filters was a few kilohertz. Advances in present-day 
microelectronics are continuously pushing back this limit. In recent 
time, digital signal filtering has been given a new momentum in its 
progress by the advent of relatively inexpensive and reliable 
microprocessors and memory units based on large-scale and 
very-large-scale integrated (LSI and VLSI) circuits. 

Signal quantization in digital filters. A distinction of any digital 
device is that signals are represented as numeric sequences with 
a limited number of digit positions. Therefore, the sampled signal is 


The digital signal pro¬ 
cessor 


The digital-to-analog 
converter 
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quantized, that is, represented by a set of levels in such a way that 
the minimum difference between adjacent levels, or the quantization 
interval, is equal to the 1 in the least significant bit position. 
The exact signal value in binary notation has the form: 

00 

x= £ a « 2_ " (15.28) 

m = 0 

where the coefficients a n are either zeros or ones. When the length 
of the number is limited to N digit positions, the exact value gives 
q way to what is known as the rounded-off (or machine) value 

The machine repre- N ~ l ^_ n ^_ N 

sentation of a number x_ S +Piv2 (15.29) 

in a digital filter m ~° 


Quantized signals 



where the coefficient Pat is equal to either a a/- or oqv + 1, according 
as the (N + l)st bit position contains a zero or a one. 

In communication engineering, sampled signals represented by 
a countable set of levels or amplitudes are called amplitude- 
quantized or, simply, quantized signals. Signal quantization leads to 
a difference between the input signal and the quantized output. This 
difference is called the quantization noise. A straightforward path to 
minimize the quantization noise is to use multibit binary numbers. 
However, this inevitably reduces the speed of the digital filter 
because it takes more time to process multibit numbers. Therefore, 
practical microprocessors employed in sampled-data processing and 
sampled-data control systems ordinarily use binary numbers with 
4 to 16 bit positions. 

It may be added that quantization is also used in continuous- 
signal techniques, especially in various types of noise-immune pulse- 
modulated systems. 

The algorithm of linear digital filtering. The mathematical theory 
of digital filters carries over to the case of discrete signals all the 
basic considerations known from the theory of linear systems used 
to transform continuous signals. 

As will be recalled, a linear stationary system transforms 
a continuous input signal x(t) in such a way that its output delivers 
a wave y(t) equal to the convolution of x(t) and the impulse 
response h(t): 

00 

y(t)= J x(x)h(t — r)dt (15.30) 

— 00 


A digital filter is a system (which may be a physical device or 
a computer program) which transforms a series, {xk}, of samples of 
the input signal into a series, {yk}, of samples of the output signal: 

(x 0 , x l9 x 29 ...)=>(y 0 , y l9 y 2 , .-..) (15.31) 
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or, in compact form, 

{xk}=*{yk) 

A linear digital filter is characterized by the fact that the sum of 
any number of input signals multiplied by arbitrary coefficients is 
transformed into the sum of its responses to the individual terms. 
That is, from the correspondences 

. 

it follows that 

«i {xlc 1 *} + ... + a n {ohyk 1 ' + ... + ajv y\ c^} (15.32) 

for any coefficients a x , ot 2 , ..., ow. 

So that Eq. (15.30) can be generalized to the discrete case, we 
introduce the concept of the impulse response for the digital filter. 
By definition, this is a discrete signal {hk} which is the response of 
the digital filter to a “unit impulse” (1, 0, 0, 0, ...): 


The impulse response 
of a digital filter 




(1,0, o.o, ...)MK KK •••) 


(15.33) 


A linear digital filter is stationary if the shift of the input unit , , 
impulse by any number of sampling intervals causes the impulse 0 x 2 

response to be shifted in a similar way, without any change in 
shape. For example: 


(0, 1, 0, 0, ...)=>(0, h 0 , h v h 2 , ...), (15.34) 

(0, 0, 1, 0, ...)=>(0, 0, h 0 , V h 2 , „.) 

Let us see how the properties of linearity and stationarity lead to 
the most common algorithm for the digital filter in question. Let 
\ Xk } = (x 0 , x 1; x 2 ,.. •) be a signal applied to the input of the digital 
filter. The impulse response of the filter is known in advance. Using 
Eqs. (15.32) and (15.34), we may directly write the mth sampled 
value of the output signal {yt}: 


y m = x 0 h m + x 1 h m _ 1 + ... + x m h 0 — £ Xfchm-fc 

k = o 


(15.35) 


Digital filter 

~T 



Equation (15.35), which plays a leading role in the theory of 
linear digital filtering, tells us that the output series is the discrete 
convolution of the output signal and the impulse response of the 
filter. The meaning of the equation is simple and easy-to-visualize: 
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At each sampling instant, a digital filter performs the operation of 
the weighted summation of all previous values of the input signal, 
with the samples of the impulse response playing the role of the 
series of weighting coefficients. In other words, a digital filter has 
m some sort of “memory” for the past inputs. 

The physical realizabi- 0n ty physically realizable digital filters are of practical interest, 
lity of a digital filter ^or a physically realizable digital filter, its impulse response cannot 
be nonzero at the sampling instants preceding the instant when the 
input pulse is applied. Therefore, for physically realizable systems 
the coefficients h_ l9 h_ 2 , ... vanish, and the sum in (15.35) may be 
taken solely over all positive values of the index k : 

00 

ym= Y Xkhm-k. rn = 0, 1, 2, ... (15.36) 

k = 0 


A harmonic series or 
sequence 


The discrete repre¬ 
sentation of harmonic 
signal does not yield 
a unique result 


Discrete harmonic sequences. As will be recalled, complex signals 
of the form x (£) = A exp [j (cot + cp)], representing harmonic waves 
play a special role in the theory of linear systems. When such 
a signal is sampled, the result is a harmonic series or sequence 

{x k } = {A^ kA+ ^} (15.37) 

such that 

Re {x/J = {A cos (cd/c A + (p)} (15.38) 

It should be borne in mind that the sequences defined in (15.37) 
and (15.38) do not represent sampled harmonic signals in a unique 
manner. Indeed, these sequences will not change if we replace the 
frequency co with co + 2nn/A = co + n co s , where n is any integer and 
co s is the angular sampling frequency or rate. Therefore, we cannot 
in principle tell from one another two sampled harmonic waves if 
they differ in frequency by a whole-number multiple of the 
sampling rate. 

The frequency response of a digital filter. Suppose that the input 
of a linear stationary digital filter accepts a harmonic sequence {xk} 
such as defined in (15.37), which is unbounded in time, that is, with 
the index k capable of taking values 0, ±1, ±2, ... .In order to 
find the output signal of the filter, {y k } 9 we take advantage of the 
convolution in (15.35) and determine the mth sample at the output: 

m m 

ym= X xkhm-k = Acxp{jy) £ exp(/co/cA)/z m _/c 

k — — oo k = — oo 


On carrying out identity transformations, we get 

m 

y m = 4e ,<tomA+<f>) £ 

k= — oo 
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Let us introduce a new summation index n — m k. Then 

00 

y m= Aei (WmA+V) Y e -;< “” A /in (15.39) 

n =o 

As follows from Eq. (15.39), the output signal has the structure of 
a discrete harmonic sequence of the same frequency as the input 
signal. The output samples are derived from the input samples by 
multiplying the latter by the complex number 


00 

K (/to) = Y ex P (~ j ® n ^ h n (15.40) 

n=0 


called the frequency response of the digital filter. It depends on the 
frequency co of the input signal, the sampling interval A, and the set 
of coefficients, {h n } 9 of the impulse response of the digital filter. 
From Eq. (15.40) we may draw the following important conclusions: 

1. The frequency response of a digital filter is a periodic 
frequency function with a period equal to the sampling rate cos = 

= 2tc/A. 

2. The function K(j co) may be treated as the Fourier transform 
of the impulse response of a digital filter, represented by a series of 
delta impulses: 

/id(0 = h 0 8(t) + h 1 8(t — A)+ ... 

(Compare with Eq. (15.23).) 

The system function of a digital filter. The frequency response of 
a digital filter can conveniently be found using the techniques of the 
z-transformation. 

Given the three sequences of discrete signals {xk}, {y k } and {h k }, 
their z-transforms will be X (z), Y(z) and H (z), respectively. The out¬ 
put signal of a digital filter, {y k }, is the convolution of the input 
signal and the impulse response, so [see Eqs. (15.27) and (15.35)], 
the function corresponding to the output signal is 

Y(z) = H(z)X (z) ( 15 - 41 ) 

The ratio of the z-transform of the output signal to the 
z-transform of the input signal is called the system function of 
a stationary linear digital filter. From Eq. (15.41) we find that the 
system function of such a filter, defined by 


OO 

H(z)= Y(z)/X(z) = Y h k z ~ k (15 ' 42) 

k — 0 


m 

The structure of the 
output signal of a di¬ 
gital filter 


• 

The frequency respon¬ 
se of a digital filter 
shows a periodic beha¬ 
viour 


Relation between the 
system function and 
the impulse response 
of a digital filter 


is the z-transform of its impulse response. 
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Comparing Eqs. (15.40) and (15.42), we can draw the follow¬ 
ing conclusion: The frequency response of a digital filter 
gan be deduced by inserting z = exp(/coA) in its system function. 


Example 15.3. Consider a digital filter whose impulse response 
consists of two nonzero samples: {h k } = ( 1, - 1, 0, 0, 0, ...) and find 
its frequency response K (j to). 

Here, the system function is 

H(z)=l-z~ 1 


Hence, 

K (/co) = 1 - exp ( - ;©A) = (1 - cos ©A) + j sin ©A 
= | K (/'©) | exp \j q> K (©)] 

The amplitude response of the filter takes the form 
I K (/®) I = j/(l - cos ©A) 2 + sin 2 ©A = 21 sin 1 
and its phase response is 


9k (®) = arc tan 


sin coA 
1 — cos coA 


The amplitude and phase characteristics of the filter are periodic 
functions of frequency, but practically they are meaningful only in 
the interval from 0 to co = n/A. At the upper frequency limit of this 
interval, two samples correspond to each period of the sampled 
harmonic signal. By the Kotelnikov sampling theorem, this is the 
highest frequency of the signal that can be uniquely recovered from 
its samples. 

It is to be noted that if the input to such a filter is a harmonic 
signal at a frequency substantially below the sampling rate such 
that coA«l, then 


K(j(o)x 


1-1 + 


(coA) 2 

2 



xj co A 

Therefore, the system in question performs the operation of 
approximate differentiation with respect to the slow input signals. 


▲ 

Work Problem 8 


15.5 Implementation 

of Digital Filtering Algorithms 

In order to form the output signal corresponding to the zth 
sampling instant, physically realizable filters operating in real time 
may use the following initial specifications: (a) the value of the 


Ch. 15 Principles of Digital Filtering 


469 


input signal at the zth sampling instant and also a number of “past” 
input samples x i ^ 1> x t _ 2 ,..., M-m \ (b) several past samples of the 
output signal, x , y*_ 2 yi-n- The integers m and n define the 
order of a digital filter. 

According to the manner in which information about the past 
states of the system is utilized, digital filters can be classed into 
several types. 

Transversal digital filters. This term refers to digital systems 
which operate by the following algorithm: 

yi = a 0 Xi + + fl 2 *z-2+ ••• + a m Xi- m (15.43) 

where a 0 , a l9 ..., a m are a series of coefficients. The number m is the 
order of the transversal filter. As is seen from Eq. (15.43), 
a transversal filter carries out the weighted summation of the 
previous samples of the input signal and does not use any previous 
samples of the output signal. By taking the z-transforms of both 
sides of Eq. (15.43), we see that 

Y(z) = (< a 0 + a 1 z~ 1 + a 2 z~ 2 + ... + a m z~ m )X(z) 

Hence, the system function of the filter 

H (z) = a 0 + a i z 1 + a i z 2 + ---+#m z m 

a 0 z m + djz m ~ 1 + a 2 z m 2 + ... + a m (15 44) 

z m 

is a rational function of z, which has m-tiple pole for z = 0 
and m zeros whose coordinates are defined by the coefficients of 
the filter. 

The algorithm by which a transversal digital filter operates 
is illustrated by the block diagram of Fig. 15.7. The basic building 
blocks of the filter are the delay units, z _1 , which delay the samples 
for one sampling interval, and also the scalers which multiply by 
the corresponding coefficients in digital form. From the scalers, the 
signals are routed to an adder where they are combined to yield the 
sampled value of the signal. 

From the structure of the block diagram, it is clear why 
this filter is called transversal. 

Program (software) implementation of a transversal filter. It 

should be borne in mind that the block diagram appearing 
in Fig. 15.7 is not a kind of schematic diagram for some electric 
network, but only a graphical representation of the algorithm for 
signal processing. As an example, consider a fragment of 
a FORTRAN routine implementing transversal digital filtering. 

Let the internal computer memory contain two one-dimensional 
arrays of M locations each. One array, X, contains the values of the 
input signal; the other array, A, holds the coefficients of the filter. 
The data in the arrays are disposed in the following manner. 


The order of a digital 
filter 


The form of the system 
function of a transver¬ 
sal filter 


In a digital processor 
the samples are de¬ 
layed for one bit by 
a shift register 
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It is assumed that the 
input samples and the 
filter coefficients are 
represented by real 

numbers 


The form of the im¬ 
pulse response of a 
transversal filter 



Fig. 15.7 Block diagram of a transversal digital filter 

Array A holds constants, whereas the contents of the locations in 
array X change each time a new sampled value of the input signal 
is received. Suppose that array X is filled full with the previous 
sampled values of the input series and consider the situation arising 
when there arrives the next sampled value which the program has 
named the variable S. This sampled value must be stored in 
location 1, and this can happen only after the previous record has 
been shifted one position to the right, that is, backward. 

The elements of array X thus formed are multiplied one by one 
by the elements of array A, and the result is stored in location 
Y which accumulates the sampled value of the output signal. The 
routine for transversal digital filtering is given below: 


DOl K = 1, M — 1 

1 X (M — K + 1) = X (M — K) 

X(l) = s 

C ARRAY X IS FORMED 
Y = 0 

D02 K= 1, M 

2 Y = Y + X(K)*A(K) 

The impulse response. Let us go back to Eq. (15.44) and find the 
impulse response for a transversal digital filter by taking the inverse 
z-transform. It is easy to see that each term of the system function 
H (z) is responsible for a contribution which is equal to the 
corresponding coefficient aj shifted j bits backward. Thus, here 

{h} K, ^15 a 2 , • ••> a m ) (15.45) 

This result can be obtained directly by inspection of the block 
diagram of the filter in Fig. 15.7, assuming that it is driven by 
a unit pulse ( 1 , 0 , 0 , 0 , ...). 

It is important to note that the impulse response of a transversal 
filter contains a finite number of members. 
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The frequency response. By a change of variable, z = exp (/coA) in 
Eq. (15.44), we get 

K(/©) = a 0 + a 1 e - - ,<nA + a 2 e^“ A + ... + a^ ma>A (15.46) 

With any specified sampling interval A, we can obtain a fairly 
wide variety of amplitude and phase characteristics by choosing 
appropriate weighting coefficients for the filter. 


This type of filter 
is said to perform 
smoothing by trees 


Example 15.4. Investigate a second-order transversal digital filter 
which takes the average of the present value of the input signal and of 
its two previous samples: 


yi = y(*i + *i-i + x i- 2 ) 


(15.47) 


The system function of the filter is 
H(z) = y(l+Z - 1 + Z“ 2 ) 


Hence, the frequency response of the filter is 


£(/©) = j( 1 + e - - /coA + e^' 2 “ A ) 


= —171 + cos ©A + cos 2coA) - j (sin ©A + sin 2©A)] 
3 



Simple manipulations lead to the following expression 
amplitude response: 

for the 

A 

Solve Problem 9 

| X(/co) | y l/3 + 4coscoA 4- 2cos2coA 

(15.48) 


and for the phase response of the system: 



, v , sin coA + sin 2coA A 

(p^(co) = — arc tan-- t—;-~ A -= — <»A 

v ’ 1 + cos coA + cos 2coA 

(15.49) 


Input 

10 Q 0 9 


\s 


“11—41 

-2/3 . Output 


Their plots appear in Fig. 15.8 where the phase angle, ©A, of the 
sampling interval for a given value of frequency is laid off as 
abscissa. 

Suppose that ©A = 60°, which means that six samples are taken 
over each period of the harmonic input wave. Then the input 
sequence will have, say, the following pattern 

..., 0 , 1 , 1 , 0 , - 1 , - 1 , 0 , 1 , 1 , ... 

(the absolute values of samples are immaterial, because the filter is 
linear). Using the algorithm in (15.47), we find the output sequence: 


2 2 _ _2 _ 2 _ 
y T’ 3’ 3’ 
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0 90 180 270 360 wA,deg 



Fig. 15.8 Characteristics of the transversal digital filter examined in 
Example 15.4: (a) amplitude response; ( b ) phase response 


As is seen, it corresponds to a harmonic output signal of the 
same frequency as the input signal, but with an amplitude which is 
2/3 = 0.66 the amplitude of the input wave, and with the initial 
phase shifted by 60° lagging. 

If ooA<120°, the filter could act as a low-pass filter since it 
smoothes the input sequence. However, its frequency response is 
periodic and nonmonotonic. If the original analog signal has not £ 
been subjected to preliminary frequency filtering and contains The effect of superpo- 
components for which coA > 180° (so that the requirement of the sition 
Kotelnikov sampling theorem is not satisfied), they will not be 
attenuated by the digital filter in question. In fact, from the samples 
of these high-frequency components the digital-to-analog converter 
would reconstruct some low-frequency wave not present in the 
input signal. This undesirable event (the effect of superposition or 
masking by the high-frequency components of the spectrum) is in 
principle inherent in any digital system and makes mandatory the 
preliminary processing of signals which are to be subjected to 
digital filtering. 


Recursive digital filters. A distinction of this type of digital filter 
is that the zth sample is formed using the previous values of both 
the input and output sequences: 

37 = a 0 Xi + a x Xi - i + ... + a m x_ m + b^i^ x + b 2 J7- 2 + ••• + k n y.i-n 

(15.50) 

where the coefficients b u b 2 , b n defining the recursive part of the 
filtering algorithm are not equal to zero simultaneously. To stress 
the difference in structure, it is usual to call transversal digital filters 
nonrecursive. 

The system function of a recursive digital filter. On taking the 
z-transforms of both parts of the recursion relation (15.50), we find 
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that the system function 


H(z)=Y(z)/X(z) = 


a 0 + a x z 1 + ... + a n z n 
1 — b x z ~ 1 — ... — b n z~ n 


a 0 z n -\-a 1 z n 1 


+ a m z 


z n -b 1 z n ~ 1 -...-b n 


(15.51) 


describing the frequency behaviour of a recursive digital filter has 
n poles in the z-plane. If the coefficients of the recursive part are 
real, the poles either lie on the real axis or form complex-conjugate 
pairs. 

The block diagram of a recursive digital filter. In block-diagram 
form, the algorithm answering Eq. (15.50) appears in Fig. 15.9. As 
is seen, the top part of the block diagram corresponds to the 



Fig. 15.9 Block diagram of a recursive digital filter 



Fig. 15.10 Canonic 2nd-order recursive filter 


Recursion is a mathe¬ 
matical technique con¬ 
sisting in that the data 
obtained at the pre¬ 
vious steps are cycli¬ 
cally referred to 


The form of the system 
function of a recursive 
filter 
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The canonic form of a 
digital filter 


41 

The stability of a digi¬ 
tal filter 


transversal (nonrecursive) part of the filtering algorithm. In the 
general case, its implementation calls for m + 1 scaling 
(multiplication) blocks and m memory cells to store the input 
samples. 

The recursive part of the algorithm provides for the use of 
n consecutive values of the output signal, which are shifted from 

location to location during the operation of the filter. 

A disadvantage of the above realization principle is that it calls 
for a large number of memory cells, separately for the recursive and 
the nonrecursive parts. A far better choice is offered by canonic 
recursive digital filters which use the least possible number of 
memory cells equal to the largest of the numbers m and n. As an 
example, Fig. 15.10 shows the block diagram of a 2nd-order 

canonical filter for which the system function has the form 


_ a 0 + fljZ 2 

1 — b x z ~ 1 — b 2 z ~ 2 


(15.52) 


To make sure that the system in question realizes the specified 
function, consider an auxiliary digital signal {w k } at the output of 
adder 1 , and write two obvious equations: 


w k = x k + b 1 w k _ 1 + b 2 w k _ 2 
T/c = a 0 w /c + «i w /c-i +a 2 w k - 2 


(15.53) 

(15.54) 


On taking the z-transform of Eq. (15.53), we get 

■FW- , 

1 —b x z - b 2 z 

By virtue of Eq. (15.54), however, 

Y (z) = ( a 0 -b a x z ~ 1 + a 2 z ~ 2 )W (z) 


(15.55) 

(15.56) 


On combining (15.55) and (15.56), we arrive at the specified system 
function in (15.52). 

The stability of recursive digital filters. A recursive digital filter is 
a discrete counterpart of a dynamic system, because its memory 
elements store information about its previous states. Therefore, if 
we specify some initial conditions, that is, a set of values (y t _ b 
y I -_ 2 , ..., yi-n), the filter will cyclically form the elements of an 
infinite sequence (y b y i+u ...) which acts as the free oscillations 
(transient response) at the output. 

A recursive digital filter is called stable, if the free (transient) 
process occurring within it is a nonincreasing sequence, that is, if, 
with n tending to infinity, {y n } does not exceed some preset positive 
number M, irrespective of the choice of initial conditions. 

On the basis of Eq. (15.50), free oscillations in a recursive digital 
filter must be the solution of the following linear difference 


Ch. 15 Principles of Digital Filtering 


475 


equation: 

y i = b 1 y i - 1 +b 2 y i - 2 + ... + b„yi~„ (15.57) 

By analogy with linear differential equations, we will seek the 
solution of Eq. (15.57) in the form of an exponential function 

yi = af (15.58) 

in which a is as yet unknown. On substituting (15.58) into (15.57) 
and cancelling out the common factor, we find that a must be 
a root of the characteristic equation 

a n _ b ^n -1 _ hi yn -2 _ _ bn = o (15.59) 

which, on the basis of (15.51), fully checks with the equation 
satisfied by the poles of the system function of a recursive digital 
filter. 

Suppose we have found all the roots oq, oe 2 , ..., a„ of Eq. (15.59). 
The general solution of the difference equation (15.57) has the form 

y i =A 1 a[+A 2 a. l 2 +...+A t fli , n (15.60) 

in which the coefficients A 1 , A 2 , ..., A n must be matched so as to 
satisfy the initial conditions. 

It can be noted that if no one of the poles of the system function 
H(z\ that is, the numbers z t = oq, ..., z n = a n , exceeds unity and 
therefore they all lie inside the unit circle with centre at z = 0, then, 
by virtue of (15.60), any free (transient) process in a digital filter will 
be described by the members of a converging geometric 
progression, and the filter will be stable. 

Clearly, only stable digital filters can be used practically. 


Transversal digital fil¬ 
ters are not dynamic 
systems, and they are 
stable with any choice 
of coefficients 


The stability criterion 
for a recursive digital 
filter 


Example 15.5. Investigate the stability of a 2nd-order recursive 
filter whose system function is 


The characteristic equation 
z 2 -b 1 z-b 2 = 0 


has the roots 

2i. 2 = -y± l/0>i /2) 2 + fr 2 

The curve described by the equation b\ + 4 b 2 = 0 on the (b l9 b 2 ) 
plane is the boundary above which the poles of the system function 
are real, and below which they are complex conjugate. 

For complex conjugate poles, 

I z i,2 \ 2 = ~b 2 


16* 
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Therefore, one of the stability boundaries is the straight line b 2 = 

= — 1. If we consider real poles for b 1 >0, the condition of 
stability will have the form 

h /2 + !/(*>! /2) 2 + Z> 2 <l 
or 

]/(bJ2f + b 2 <l-b 1 /2 

By squaring both sides of the above inequality, we can see that the 
stability region is bounded by the straight line b 2 = 1 —b 1 . The case 
when b x < 0 can be analysed similarly. A 

Solve Problem 10 



-l 


Fig. 15.11 Stability region for a 2nd-order recursive filter. (The filter poles 
are complex conjugate inside the coloured area.) 

To sum up, the recursive filter in question is stable if the values 
of the coefficients b, and are located inside the triangle shown in 
Fig. 15.11. 


Solve Problem 11 


The impulse response of a recursive digital filter. A distinction of 
a recursive digital filter is that it contains feedback loops. In 
consequence, the impulse response of a recursive digital filter is 
described by an unbounded time sequence. We will demonstrate the 
statement by reference to an elementary lst-order filter whose 
system function is 

H (z) = j ^ _ i = az/(z - b ) 


The filter is stable, if |fc| < 1. 

As will be recalled (see Eq. (15.42)), the impulse response is found 
by taking the inverse z-transform of the system function. Using 
Eq. (15.21), we find the rath member in the sequence {hk}: 


1 /h az m dz 


T —r (15 - 61) 

2nj J z — b 

The integration is carried out around the unit circle inside which 
the pole z = b is located. 
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Since, as can be readily seen, the residue of the integrand at the 
pole is equal to ab m , the sought impulse response of the filter is 
a decreasing geometric progression 

{/z/ c } = (u, ab , ab 2 , ...) (15.62) 


15.6 Synthesis of Linear Digital Filters 


Currently, special emphasis in the synthesis of digital filter struc¬ 
tures is placed on the techniques and procedures assuring some 
desired properties which may be a particular shape of the impulse 
or frequency response [35]. In the pages that follow we will be 
mainly concerned with synthesis procedures which substantially 
draw on the properties of the analog circuits that serve as 
prototypes for the digital filters being synthesized. 

Ordinarily, a digital filter is synthesized with the aid of 
a computer. The number of significant digits in the final results 
must be sufficient for the desired accuracy to be achieved. 
Obviously, the filter must be stable in any case. 

The invariant impulse response method. This is the simplest 
method for digital filter synthesis. It is based on the assumption 
that the impulse response of the filter being synthesized must be the 
same as will be produced by digitizing the impulse response of the 
corresponding analog prototype. Bearing in mind that we are 
concerned with the synthesis of physically realizable systems for 
which the impulse response is zero at t < 0, we obtain the following 
expression for the impulse response of a digital filter 

{h k }=(h( 0), h (A), h(2 A), ...) * (15.63) 

The number of samples in the impulse response sequence of 
a digital filter may be finite or infinite. Accordingly the structure of 
the filter will be different: An impulse response with a finite number 
of samples corresponds to a transversal filter; an impulse response 
with an infinite number of samples corresponds to a recursive filter. 

The relation between the coefficients of the impulse response and 
the structure of a digital filter is especially simple in the case of 
a transversal filter. In the general case, the search for the desired 
structure is begun by taking the z-transform of the sequence in 
(15.63). Once the system function H(z) of the filter is obtained, the 
next step is to compare it with the general expression (15.51) and to 
determine the coefficients of the transversal and recursive parts of 
the filter. 

The degree of approximation between the frequency characteristic 
of the digital filter being synthesized and that of the analog 
prototype depends on the choice of the sampling interval A. If 
necessary, the frequency response of the digital filter can be found 
by a change of variable, z = exp(/coA), in the system function H(z\ 


The principle of simi¬ 
larity between the im¬ 
pulse responses of ana¬ 
log and digital filters 
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and by comparing the result thus obtained with the known fre¬ 
quency response of the analog network. 


Example 15.6. Go through the synthesis of a transversal digital 
filter similar to a lst-order dynamic system (say, an integrating 
RC-netxvork) whose impulse response has the form 
0, t <0 

exp ( —t/x), t>0 


h(t) = 


(15.64) 


(The amplitude coefficient in the impulse response is set equal to 
unity, as it is of minor importance to the synthesis procedure.) 

Suppose that the impulse response is approximated by 
a sequence of three equidistant samples: 

{h k } = ( l,e-^,e- 2A/T ) (15.65) 


The transversal digital filter having this form of impulse response is 
described by the following difference equation: 

y k = x k + e” A/x x k _ i + e" 2 A/x x k _ 2 (15.66) 

By taking the z-transform of the sequence in (15.65), we obtain 
the system function of the digital filter: 

H(z) = 1 + e" A/x z -1 + e- 2A/T z- 2 (15.67) 

Hence, the frequency response is 

K (/co) = 1 +e - A/T e-^ A +e- 2A/T e- J2 “ A (15.68) 

Example 15.7. Consider the case where the impulse response 
(15.64) of an analog network is approximated by the infinite discrete 
sequence 

{h k } = ( l,e- A/T ,e- 2A/T ,...) (15-69) 

By taking the z-transform of the impulse response in (15.69), we 
obtain the system function 

H(z) = 1 + e~ a / t z - 1 + e -2A / T z -2 + ... 

= 1/(1 -e-^z" 1 ) (15.70) 

This system function defines a lst-order recursive digital filter 

which contains an adder, a scaler, and a delay unit. 

The frequency response of the synthesized filter is 

= 1 _ e -l /Te - >A 05.71) 


Comparison of transversal and recursive digital filters. It is fre¬ 
quently required that the frequency characteristic of a digital filter 
being synthesized should approximate that of the analog prototype 
with sufficient accuracy. The choice of a particular filter structure 
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within the framework of the invariant impulse response method has 
a marked effect on the accuracy of approximation. 

Let us compare the frequency characteristics of the two digital 
filters examined in Examples 15.6 and 15.7. Both correspond to an 
analog prototype whose frequency response is 

K (/co) = 1/(1 H- ;oox) (15.72) 

On putting t/A = 5 to make the matters more specific and on 
carrying out simple manipulations on the basis of Eqs. (15.72), 
(15.68) and (15.71), we can write the following expressions for the 
normalized amplitude response of the analog filter and of the two 
digital filters, recursive and transversal 



K(j co) 
K(j 0) a 
K(ja>) 
KUO) r 
K(j(0) 
KUO) t 


1 

]/l + 25© 2 A 2 
0.1811 

j/1.6703- 1.6375 cos ©A 

]fl. 120 + 2.7351 cos ©A + 1.3406cos2coA 

2.48903 


(15.73) 


(15.74) 


(15.75) 


▲ 

Solve Problem 12 


The values of | K (/cd)/K (jO) |, as found from the above equations, 
are summarized in Table 15-1. 


Table 15-1 


coA 


Filter type 


analog 

m digital 
recursive 

digital 

transversal 

0.0 

1.0000 

1.0000 

1.0000 

0.5 

0.3714 

0.3754 

0.9200 

1.0 

0.1961 

0.2046 

0.7005 

1.5 

0.1322 

0.1454 

0.3963 

2.0 

0.0995 

0.1182 

0.1305 

2.5 

0.0797 

0.1050 

0.2234 

3.0 

0.0665 

0.1000 

0.3360 



As is seen, both the recursive and the transversal digital filter has 
the frequency characteristics of a low-pass filter. However, the 
recursive filter is closer in properties to the analog prototype than 
the transversal filter. 

Digital filter synthesis by digitization of the differential equation 
of the analog prototype. A digital filter structure approximately 
corresponding to a known analog network can be derived by 
digitizing the differential equation which describes the analog 
prototype. As an example of the procedure, we will go through the 
synthesis of a digital filter similar to a 2nd-order dynamic system 
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Higher-order finite- 
difference procedures 
may also be used 


The digital resonator 


for which the relation between the output wave y(t) and the input 
signal x(t) is established by the differential equation 

d 2 y/dt 2 + 2ccdy/dt 4- co ly = x ( t ) (15.76) 

Suppose that the sampling interval is A, and consider two sets of 
samples, {yk} and {x/c}. If in Eq. (15.76) we replace the derivatives 
with their finite-difference expressions, the differential equation will 
turn into a difference equation 

- ~ 2yn ?2 - — + (0 ly n = x n (15.77) 

A 2 A 

On re-grouping, we get 

A 2 x n -I- 2(1 + oA )y n -i — y n -i iA c no ^ 

y n =- - - (15.78) 

where A = 1 — 2ocA + cOoA 2 . 

The difference equation (15.78) defines the algorithm for the 
2nd-order recursive filter which models an analog oscillatory 
system. This form of digital filter is called a digital resonator. If the 
coefficients have been properly chosen, a digital resonator can 
operate as a frequency-selective bandpass filter similar to a resonant 
(tuned) circuit. 

The invariant frequency characteristic method. There are basic 
reasons why it is impossible to build a digital filter whose frequency 
behaviour would exactly replicate that of some analog network. 
One reason is that the frequency response of a digital filter is, as 
will be recalled, a periodic function of frequency with a period 
decided by the sampling interval A (Fig. 15.12). 

As regards the similarity between (or the invariance of) the fre¬ 
quency behaviour of an analog and a digital filter, we may only 



Fig. 15.12 Comparison of amplitude responses: (a) analog filter; (b) digital 
filter 
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require that all of the infinite frequency interval co a associated with 
the analog system be transformed into the frequency interval cod 
associated with the digital filter, such that 

- n/A < cod < rc/A 

with the amplitude response retaining its general shape. 

. Let K a {p) be the transfer function of an analog filter, specified by 
a rational function in powers of the complex frequency p. Taking 
advantage of the fact that z = exp(pA), we may write 

p = (l/A)lnz (15.80) 

From this relation, however, we cannot deduce a physically 
realizable system function for the digital filter, because the substi¬ 
tution of (15.80) into the expression for K a (p) would result in 
a system function which is not the quotient of two polynomials. It 
is required to find a rational function of z which would possess the 
basic property of the transform (15.80), that is, which would map 
points on the unit circle in the z-plane into points on the jco-axis in 

the p-plane. . . . 

Among the various procedures, the following relation is widely 

used [35] 


p = (2/A)(z — l)/(z + 1) ( 15 - 81 ) 


The principle of simi¬ 
larity between the fre¬ 
quency responses of 
analog and digital fil¬ 
ters 


The function in (15.81) 
is called the bilinear 
transformation 


which establishes a one-to-one correspondence between points on 
the unit circle in the z-plane and the entire imaginary axis in the 
p-plane. A salient feature of this form of mapping is as follows. By 
a change of variable, z = exp (j®sA), in (15.81), we get 

2 exp (/co s A) — 1 
^° a A exp(/cOsA)+l 

Hence, the following relation between the frequency variables co a 
and CDs of the analog and the digital system respectively, emerges: ^ 

Relation between the 
frequency variables of 
(15.82) ^ analog and a digi¬ 
tal filter 

If the angular sampling rate is sufficiently high (cd s A « 1), then, as 
can be readily seen from Eq. (15.82), cD a ~co s . Thus at low fre¬ 
quencies the characteristics of an analog filter and of a digital filter 
are about the same. In the general case, one should consider the 
scale transformation along the frequency axis of the digital filter 

described by Eq. (15.82). . 

Practically, the synthesis of a digital filter consists in that the 


oo a = — tan (cosA/2) 
A 
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variable in the function K a (p) is changed in accord with Eq. (15.81). 
The system function thus obtained is a rational function, so the 
digital filtering algorithm may be written directly. 


Example 15.8. Synthesize a digital filter whose frequency behaviour 
is similar to that of a 2nd-order Butterworth analog low-pass filter. 
The cut-off frequency for the digital filter must be co c ,d= 1500 s” 1 . 
The sampling rate is co s = 10000 s “ L 
To begin with, we find the sampling interval 

A = 2tc/co s = 6.2832 x 10“ 4 s 


By Eq. (15.82), the cut-off frequency of the Butterworth analog filter 
similar to the digital filter being synthesized is 

2 co c aA 

co ca = ——tan ——— = 1621.9 s _ 1 
’A 2 

As will be recalled, the transfer function of a 2nd-order 
Butterworth analog filter, written in terms of the normalized 
complex frequency pw, has the form (see Chap. 13) 

Kz( P n ) = -p- (15.83) 

Pn + J/2 Pn + 1 

or, changing back to the true complex frequency, 


*a(p) = - 


®c,a 


r - (15.84) 

p 2 + ]/ 2cO ca p + C0c,a 

By a change of variable in (15.84) in accord with Eq. (15.81), the 
system function of the digital filter is 


~^\ + l/2tt>c,a 


t) + ®^ a ] 


z 2 4- 2 


©c,a' 



(15.85) 


On substituting the numerical values in the above expression, we 
get 


H(z) = 


z 2 + 2z + 1 

1.6212z 2 - 5.7033z + 2.0761 


(15.86) 


The effect of quantization on the performance of a digital filter. 

In the synthesis and design of digital filters it is important in some 
cases to consider the specific errors arising from signal quantization 
by which all quantities, both constant and time-varying, are turned 
into binary numbers of a finite length. 
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Quantization results in a fairly wide range of effects. They are all ^ 
examined in the literature on digital filtering [35]. Here we will be Q uan tj za tion noise 
concerned with the quantization (or quantizing) noise , the simplest 
effect of all. 

Let F max be the maximum value of the analog signal applied to 
the input of the analog-to-digital converter of a digital filter, which 
does not yet cause an overflow in the arithmetic units of the filter. 

If m is the number of bits (word length) allocated to represent the 
input signal in the filter, it is then obvious that the input signal will 
be quantized into levels spaced apart by a quantization step of size 


3e=r max /2 m (15.87) 

The quantized levels represent the true instantaneous values of an 
analog signal accurate to what is known as the quantizing error 
which decreases as the step size, or the spacing between the 
quantizing levels, is reduced. So the quantized representation of the 
input signal, xk , may be visualized as the sum of the true values xk 
and the errors nk which constitute the quantization noise 

*/c= n/c (15.88) 


Solve Problem 14 


As theoretical and experimental studies have shown, in most 
cases of practical interest the error sequence {nk} is made up of 
statistically independent random variables each of which is 
uniformly distributed in the interval from - q Q ll to g e /2, and so 
the error sequence has zero mean and its variance is a 2 in = qq /12 
(see Chap. 6). 

The quantization noise present at the input of a digital filter is 
processed in the same manner as the valid signal. Let {ni n ,k} be the 
discrete sequence representing the input quantization noise. In 
order to find the Zth sample in the output noise sequence {n ou t,k}, 
we should evaluate the convolution of the input quantization noise 
with the impulse response of the filter 
00 

«out,/= ZMhU-i < 15 - 89 ) 

i = 0 


Hence the autocorrelation function of the output quantization noise 
is 


OO 

Kout ( m ) = X n ° ui >i n ° u U — m 

i= o 

The sum is taken over 
the index i 

= K[ n (m) £ hjhj- m (15.90) 

j —o 


OO OO 

- X Z Win,/ — j hj ~ m —j — m 

i = 0j = 0 
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Solve Problem 15 


On setting m = 0, the variance of the output noise is found to be 


-'out 


= K om (0) = Ki 


00 

,(0) E h) 

j = o 


,2_ii 


if W 

j — 0 


(15.91) 


As is seen, the output quantization noise increases as the roll-off of 
the impulse response of the filter slows down. 

Summary 

In contrast to analog signals, discrete (sampled) signals are represented by sequences 
of samples at a discrete set of points. 

00 The spectrum of a discrete signal consists of an infinite number of repetitions of the 
spectrum of the original analog signal. 

00 The reconstruction of the original signal from a discrete sequence of samples by a real 
frequency filter inevitably introduces signal distortion. 

00 The number of amplitude harmonic coefficients that can be found with the aid of the 
discrete Fourier transform is half the number of samples. 

00 The z-transform permits discrete sequences to be investigated by the techniques of 
mathematical analysis applicable to continuous functions. 

00 The output sequence of a digital filter is the discrete convolution of the input signal 
and the impulse response of the filter. 

00 The frequency response of a digital filter is the Fourier transform of its impulse 
response and is a periodic function of frequency with a period equal to the sampling 
frequency (rate). 

00 The system function of a digital filter is the z-transform of its impulse response. 

OO According as the filtering algorithm is realized, digital filters are customarily classed 
into transversal or recursive. 

00 A recursive digital filter is stable if all the poles of its system function are located 
inside the unit circle with centre at z = 0. 

00 In the synthesis of digital filters, it is convenient to use the impulse or frequency 
response of an analog prototype filter. 

OO The representation of quantized data as binary numbers of finite length leads to 
a specific source of error in the operation of digital filters, called the quantization 
noise. 


Review Questions 

1. Draw a block diagram for a pulse modulator. What is the difference between PAM and 
PWM signals? 

2. What is the spectrum of the sampling sequence? 

3. What is the cause of the distortion in the signal appearing at the output of 
a reconstructing low-pass filter, if its cut-off frequency is substantially higher than the 
frequency (rate) at which the input pulse sequence is sampled? 

4. Over its periodicity interval a sampled signal is specified by 16 samples. What is the hi¬ 
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ghest harmonic that can be found from these data with the aid of the discrete Fourier 
transform? 

5. Formulate the conditions of convergence for the z-transform. 

6. If the z-transform of a numeric sequence is known, how can the Fourier or Laplace 
transform of the corresponding discrete signal be found? 

7. What is the number of bit positions (word length) ordinarily used in digital filters to 
represent sampled waveforms? 

8. List the properties of the impulse response of a stationary linear digital filter. Define the 
condition that the impulse response of a physically realizable digital filter should satisfy. 

9. Why is it that the representation of harmonic analog signals with a sequence of 
equidistant samples does not give a unique result? 

10 Define the concept of the system function of a digital filter. 

11. What are the differences between the system functions of transversal and recursive 
digital filters? 

12. What is the basic difference between the impulse responses of transversal and recursive 
digital filters? 

13. Name the advantages of the canonic form of digital filters. 

14. What is the rationale of digital filter synthesis by the invariant impulse response 

method? „ , , . , 

15. Why is it impossible to synthesize a digital filter whose frequency behaviour precisely 

replicates that of the analog prototype filter? 

16. How does the shape of the impulse response of a digital filter affect the variance of the 

output quantization noise? 


Problems 

1. An analog signal x(t) is a rectangular 
video pulse of duration x p = 2 ms. Its 
sampled version is a discrete pulse sequence 
(a PAM signal) consisting of ten equidistant 
video pulses each of 5 ps duration. Find the 
spectrum of the pulse sequence. 

2. Over its periodicity interval a discrete 

signal is specified by four equidistant 
samples: {x&} = OU 0, —1, 0). Find the 

discrete Fourier transform coefficients of the 
signal. 

3. Derive the equation describing the 
analog signal x{t) reconstructed from the 
discrete Fourier transform coefficients of 
Problem 2. 

4. A periodic discrete signal has the 
following harmonic amplitude coefficients: 
C 0 = 0.5, C x = 1.5 (the coefficients of the 
higher harmonics are zero). Find the sample 
values of the signal. 


5. A sampled signal {xk} is specified by 
four samples. Find the z-transform of the 
signal: 



•-2 


6. Find the z-transform corresponding to 
an analog signal x(t) = at(t> 0), where a is 
a constant. 

7. Let the z-transform of a discrete signal 
{xk} have the form 


z 

Find the samples of the discrete signal. 
8. The impulse response of a digital filter 
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is specified by three nonzero samples: 
{hk} = (1, 0.5, 0.25). Find the system function 
and the frequency response of the digital 
filter. 

9. Draw a block diagram of the digital 
filter realizing the following algorithm: 

yi= \ J5xi~ 0.55x i _ 1 + 0.25 x f _ 2 

Find the system function. 

10. A recursive digital filter realizes the 
following algorithm: 

yi = Xi + 0.5 x - 0.75 

Analyse the digital filter for stability. 

11. Calculate and plot the impulse 
responses of the digital filters described by 
the following difference equations: 

(a) y t = 2.5xf — 0.Sy i _ 1 

(b) y i = 2.5x i -\-0.Sy i _ 1 

12. Using the invariant impulse response 
method, synthesize a transversal digital filter 
similar to an integrating RC network. The 
impulse response of the digital filter is 
specified by four equidistant samples. 
Calculate the frequency response of the 
synthesized filter on setting A/x = 0.5. 

13. Using the invariant frequency 
response method, synthesize a digital filter 
whose frequency response is similar to that 
of a 2nd-order Chebyshev analog filter with 
co c ,a = 2 x 10 3 s ~ 1 and 8 = 0.8. The 
sampling frequency (rate) is co s =1.5x 
x 10 4 s “*. 

14. The analog signal at the input of an 
analog-to-digital converter has a maximum 
amplitude V m = 50 V. The samples are 
represented by eight-digit binary numbers. 
Calculate the variance of the quantization 


noise at the output of the analog-to-digital 
converter. 

15. There is a recursive digital filter 
whose algorithm is yt = 0.45x; + 0.95y;_ 1 . 
The quantization noise at its input is 
quantized into levels spaced ^ = 0.5 mV 
apart. Find the variance of the quantization 
noise at the output of the filter. 


Advanced Problems 

16. Think of representing a periodic 
discrete signal with the aid of a Fourier- 
Walsh transform in which the basis 
functions of the form exp (- jlnnk/N) used 
in the conventional discrete Fourier 
transform are replaced by Walsh functions. 

17. Propose a digital filtering procedure 
based on the direct use of the discrete and 
inverse discrete Fourier transforms. 

18. Using FORTRAN, write a fragment 
of the routine implementing the algorithm 
for recursive digital filtering. 

19. Using the method of invariant 
impulse responses, synthesize a digital filter 
corresponding to an analog lossy resonant 
circuit whose impulse response has the form 

h (t) = exp ( — at) cos co 0 t 

20. In mathematics, a sequence of 
numbers related such that x f = x,- _ x + x t _ 2 
is called the Fibonacci sequence. Find the 
first ten Fibonacci numbers on setting x 0 = 
= 0 and x 1 = 1. Propose an analytic 
procedure for finding Fibonacci numbers of 
any order. Connect this problem to that of 
the stability of recursive digital filters. 


Chapter 16 

Optimum Linear Signal Filtering 


Noise and interference control and suppression are an important 
task in many branches of telecommunications. The high noise 
immunity of telecommunication systems can in principle be assured 
in two ways. One consists in improving the structure of the signals 
being transmitted. An example is offered by the Barker sequences 
examined in Chap. 3. The other consists in developing equipment 
capable of signal detection in noise. 

This chapter will be concerned with signal detection in noise by 
stationary linear systems acting as frequency filters. A frequency- 
selective system which processes the sum of a signal and noise in 
the best possible manner is called an optimum filter. 

The meaning that is implied in the concept of optimality varies 
among other things, according as the signal waveform is known in 
advance or not. If the signal waveform is known, an optimal filter is 
expected to detect the signal with a maximally attainable 
probability. If, on the other hand, the signal waveform is not 
known, an optimal filter must separate the signal from its mixture 
with noise as best as it can. In the latter case, an optimum filter is 
customarily taken as that which minimizes the root-mean-square 
error between the actual signal and the filter output. 


The optimum filter 


The difference between 
the detection of a 
known and an unknown 
signal waveform 


16.1 Optimum Linear Filtering of Known Signals 

The pages that follow will set forth the theory used to build 
linear optimum filters in both cases. 

The task of the optimum detection of a known signal in noise 
arises, for example, in radar. Here, the received signal s r (t) is an 
exact, scaled-down replica of the transmitted signal s t (t), that is 

Sr (t) = Asit- x) 06.1) 


where A « 1. 

The received signal may be very small and comparable in 
amplitude with the effective noise voltage present at the receiver 
input. 

A radar receiver does two jobs: (a) it detects the signal, that is, it 
establishes the fact that the reflected signal (the target echo) is 
present in the received wave; and (b) it determines the delay time x, 
which is a measure of the distance to the target. 

A specific aspect in the operation of a radar is that in processing 
the received signal the signal waveform need not be retained. In 
fact, it is desired that in the course of processing the signal be 
transformed in such a way that its application to the filter input 
would produce at some instant an appreciable “spike” in the 


l 

o 

Signal “spikes” above 
the noise level 
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instantaneous value of the output waveform. The noise present in 
the received waveform is usually Gaussian, so the probability that 
it, too, will give rise to noticeable “spikes” is negligible. Therefore, 
■ the appearance in the output waveform of a spike substantially 

The assumption that exceeding the effective noise voltage indicates the presence of the 
noise is Gaussian signal at the receiver input with a high probability. 

The signal-to-noise ratio at the output of a linear filter. We 
assume that the sum of the signal and noise is processed by 
a system which is a stationary linear filter whose frequency 
response is 

K (/CD) = I K (/co) I exp [/cpk(co)] 

The spectrum of a known signal sj n (i) at the filter input is 
*5 in (to) = | S in (CD) | exp [/CpsM] 


Using spectral analysis, we can find the signal at the filter output 
at any time t 0 

1 00 

Sout(t 0 ) = ^- J I Sin 11 -KI exp [j ((ot 0 + cps + (px)] do) (16.2) 

In 


Suppose that the noise accompanying the signal at the filter input 
is white noise for which the power spectrum W 0 is the same at all 
frequencies. Then the variance of the noise at the filter output will 
be 


The signal-to-noise ra¬ 
tio (SNR) 


w 00 

CTout = ^- 2 - J |K| 2 dco 

— 00 


(16.3) 


The ratio of the magnitude of the instantaneous value of the 
signal at time t 0 to the root-mean-square value of noise is known as 
the signal-to-noise ratio (SNR) at the filter output. Designating it as 
q and using Eqs. (16.2) and we get 


The principle of filter 
optimality for a known 
signal waveform 


q = 


5 OUt (j'o) 


2^ J \S in \\K\e^ a>t o +( f , s+VK) da 


J out 


\ 1/2 

■s-l' K ' 2d “ 


(16.4) 


An optimum filter will be one with K op t(j(o) which maximizes the 
signal-to-noise ratio at some time t 0 . This form of optimum filter is 
also called the matched filter, because it is matched to a known 
signal. 

# The frequency response of a matched filter. The task of finding 

The matched filter is handled on the basis of the Cauchy-Buniakovsky 
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inequality. By this inequality 

| J F l (x) F* 2 (x) dx K (j I Fi I 2 dx f I F 2 1 2 dx) 1/2 (16.5) 

for arbitrary functions F^x) and F 2 (x). In Eq. (16.5) the “equals” 
sign applies only when (x) = CF 2 (x), where C is a constant. 

From comparison of the left-hand side of (16.5) with the 
numerator of (16.4), let us put 

Fi((o) = |S in |exp(/cps) n6 6t 


The equation is genera¬ 
lized to functions which 
take on complex values 


F* (co) = | K | exp [/ (a>t 0 + 9 k)] 

The numerator in (16.4) will be a maximum if F 1 and F 2 are 
proportional to each other, that is, 

| Sb I exp (/cps) = C | K | exp [ - j (cot 0 + 9*)] 


The equality of two complex numbers implies that their magni¬ 
tudes and arguments are respectively equal. In our case, 

|Sin| = C|K| 

(16.7) 

9s = -tot 0 - 9 k 

Hence, we immediately deduce the expression for the frequency 
response of a matched (optimum) filter 

K op M= B|S in |exp( -;cp s )exp(-jcot 0 ) (16.8) 

where B = \/C is an arbitrary coefficient of proportionality. It is 
convenient to re-write Eq. (16.8) as 

KoptG©) = BS in (co) exp (— ;cot 0 ) (16.9) 


Thus, the frequency response of a matched filter is completely 
defined by the spectrum of the signal which the filter is intended to 
detect. The proportionality factor B in (16.9) determines the general 
level of gain due to the filter. The value of t 0 only enters the 
expression for the phase response of the filter. From the general 
properties of the spectral representation of signals we know that the 
exponential factor exp (- ja>t 0 ) is an indication that the filter 
response is shifted along the time axis by t 0 . 

Physical interpretation of the frequency response of the optimum 
filter. A filter intended to extract a known signal from a white noise 
mixture will pass the harmonic waves at the frequencies where the 
spectrum of the signal is nonzero. Also, naturally, the amplitude 
response of the filter will be proportional to the magnitude of the 
spectrum of the signal, that is, to the contribution that a particular 
frequency interval makes to the output signal. If the input signal 


The result holds if the 
noise at the output 
is white 
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The signal spectrum 
and the amplitude res¬ 
ponse of a comb filter 
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Rayleigh’s theorem is 
used 


has a discrete spectrum (such as when the signal is periodic), the 
above principle leads to comb filters widely used in 
telecommunications. 

The matched filter whose behaviour is defined by Eq. (16.9) 
functions similarly to a comb filter. However, it assures a still high¬ 
er probability of signal detection because the phase characteristic 
of the signal spectrum is utilized to a better advantage. To 
demonstrate, the signal at the output of a matched filter 

B 00 

s outW = ~2nJ S ^ s *in ex PD«>(t - r 0 )]dra (16.10) 

is obviously, at an absolute maximum 


5 out,max ^ ~WZ~ J I ^in | 2 d<X> = BE S 


2 K 


(16.11) 


In optimal filtering 
the spectral compo¬ 
nents are combined 
coherently 


(where E s is the signal energy) at time t 0 when all elementary 
spectral components of the input wave are combined at the output 
coherently, that is, in the same time phase. 

Thus, matched filtering calls for the maintenance of proper phase 
relations between the individual spectral components of the detected 
signal. 

The impulse response of a matched filter. If we know the fre¬ 
quency response of a matched filter, we can find its impulse 
response by taking the inverse Fourier transform of Eq. (16.9): 

1 00 

h(t) = — J K opt C/co) exp (/cot) dco 

— cn 


B 00 

= T- 1 Sin (©) exp [/co (t — r 0 )] dco (16.12) 

— 00 


If the input signal 
takes on a complex 
value, its real and ima¬ 
ginary parts should be 
considered separately 


As will be recalled, any real signal has the property that S&(cd) = 
= S{ n ( — co). Therefore, 


B 00 

h(t) = — J Sj n ( — co)exp[/co(f — t 0 )] dco 

-a, 

B ~oo 

= - I Sin (©') exp [/(O' (to - t)l dco' 

00 


~ ^ 5 in(^o — 0 


(16.13) 


Thus, we have proved that the impulse response of a matched 
filter is a scaled replica of the input signal, but this replica is 
a mirror image of the input signal on the time axis-this is 
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indicated by the sign of t in Eq. (16.13). Also, the impulse 
response of the filter is shifted to the right, so it is delayed from the 
signal Si n (-t) by t 0 . 

The construction of the impulse response of the matched filter for 
a specific pulse signal S[ n (t) of finite duration is illustrated in 
Fig. 16.1. 



Fig. 16.1 Construction of the impulse response for a matched filter 

Referring to Fig. 16.1, we can formulate a necessary, but not 
a sufficient condition for the physical realizability of a matched 
filter: The time parameter t 0 defining the instant when the output 
signal has a maximal instantaneous value must be not less than the 
duration of detected signal Otherwise, the impulse response of the 
system will be nonzero at t < 0, that is, before the delta-impulse is 
applied to the filter input. 

The implication of the condition is this: If the output signal of an 
optimum filter is to have a maximally possible instantaneous value, 
the filter must utilize the energy of the entire input signal. 

The waveform of the output signal of a matched filter. Suppose 
that a filter receives a noise-free signal S[ n {t) to which it is matched. 
Let us analyse the waveform of the output signal. To do this, we 
write on the basis of (16.10) 

Sout(t) = ~- ? I Sin(ro) | 2 exp[/co(t — t 0 )]dco (16.14) 

— 00 

Going back to Eq. (3.24), we can see that the output signal 
coincides to within the proportionality factor B with the 
autocorrelation function of the input signal, shifted backwards by 
t 0 , that is, 


▲ 

Solve Problem 1 

This type of matched 
filter can only be synt¬ 
hesized for signals of 
finite energy, such as 
pulses 


5 out(0 ~* BKs(t t 0 ) 


(16.15) 


As an example, Fig. 16.2 shows a plot of the signal at the output of 
some specific matched filter. 
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Waveform distortion 
does not interfere with 
the detection of a sig¬ 
nal in noise 


The maximum at¬ 
tainable SNR 


Fig. 16.2 Signal at the output of an optimum filter matched to 
a rectangular video pulse: (a) input signal; ( b ) its autocorrelation function; 
(c) output signal for t 0 = x p , that is, when the output waveform is 
a maximum just as the input pulse ceases 


It is to be noted that in the case of optimum filtering the input 
and output signals may substantially differ in waveform. 

The signal-to-noise ratio at the output of an optimum filter. If 
the power spectrum of the white noise at the input of a filter with 
the frequency response of Eq. (16.9) is W 0 , then the power spectrum 
of the output noise will be 


flout(co) = W 0 1 K opt (j(o)\ 2 = W 0 B 2 | Si n (co) | 2 (16.16) 

The variance of the output noise is found by integrating 
Eq. (16.16) over all frequencies. It is connected to the energy of the 
input signal, E s , by a relation of the form 


2 

<7out — 


w 0 B 2 

2k 


I S in (®) 1 2 dco = W 0 B 2 E s 


Hence, using the expression for the maximum response produced 
by the filter (see Eq. (16.11)), we find the maximum attainable 
signal-to-noise ratio 

*?max = I 5 out, maxIAout = ]/^s/ f^o (16.17) 

It is important to stress that Eq. (16.17) establishes the 
fundamental limit of signal detectability by device* intended to 
detect known signals mixed with white noise of specified intensity. 


Example 16.1. The signal being detected is a rectangular radio 
pulse of amplitude V 0 and duration x p = 10 ps. The white noise at the 
filter input has the power spectral density W 0 = 3 x 10“ 18 V 2 s. Find 
the minimum value of V 0 at which the signal can still be detected, if 
the receiver reliably indicates the presence of the signal with 
a signal-to-noise ratio of q = 3. 

On the basis of (16.17), the required signal-to-noise ratio will be 
realized if the signal energy is E* = 9W 0 . Since for a rectangular 
radio pulse, E s = FqX p A then F 0> m i n = 1/18IF 0 /x p = 2.32 x 10“ 6 V. 
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A remarkable property of matched filtering is that the 
probability of detecting a signal depends above all on the energy in 
the signal. Notably, we can always provide for the reliable detection Work p ro bi em 2 
of a signal with a very small amplitude, if we extend the duration of 
the pulse in a suitable manner. This will of course slow down the 
transmission of information over the channel. 


16.2 Implementation of Matched Filters 

From the above expressions for the frequency and impulse 
responses of a matched filter, it is possible to find the physical 
structure of a device intended for the optimal filtering of a known 
signal. Some of the procedures used in the synthesis are discussed 
below. 

The matched filter for a rectangular video pulse. Consider an 
elementary pulse signal S[ n (t) which is a rectangular video pulse of 
known duration x p and of an arbitrary amplitude V 0 . Our search 
for the structure of the filter matched to such a signal will be based 
on the spectral principle. To begin with, we find the spectrum of the 
signal at the filter input: 

00 X P 

Sin((o)= j Sj n (f)exp( — jcof)dt = V 0 J exp(—j'cor)dt 

— oo 0 

= (F 0 //cg) [1 - exp( — jcoxp)] (16.18) 

Hence, basing ourselves on Eq. (16.9), we find the frequency 
response of the matched filter by setting t 0 = x p , which means that 
the output of the filter is a maximum at the instant when the pulse 
ceases: 

1 — exp(/cox D ) * . 

KoptO©) = B -:- E -exp( - 7 C 0 x p ) 

-;co 

= B(1 //co) [1 — exp( — jcoxp)] (16.19) 


A 

Here the frequency 
response is not a ra¬ 
tional function, so the 
corresponding filter 
cannot be a lumped- 
parameter network 


The result thus obtained is sufficient for a matched filter to be 
synthesized. As follows from Eq. (16.19), this filter must be 
a cascaded connection of three linear elements: (a) a scaling 
amplifier with gain J B, (b) an ideal integrator, and (c) a network 
with a frequency response, K(j(o)= 1 — exp(—;cox p ) which can be 
implemented with a delay unit to delay the signal for time x p , an 
inverter to change the sign of the signal, and an adder. In 
block-diagram form, the filter thus synthesized is shown in 
Fig. 16.3. 

The matched filter for a train of identical video pulses. In radar 
the waveforms coming from the amplitude detector of the receiver 
are often combined into trains so as to build up the power in the 
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Fig. 16.3 Matched filter for a rectangular video pulse 

signal. Suppose that such a train consists of N identical video 
pulses of duration x p each; the spacing between the pulses is T. If 
S 0 (cd) is the spectrum of one pulse, then the spectrum of the train 
will be 

S t (co) = S 0 (1 + e ~ jmT + e ~ j2 mT + ... + e ~^ N ~ ^ T ) (16.20) 

In synthesizing a matched filter for a pulse train, we require that 
the response be a maximum just as the last pulse in the train 
ceases. Hence, 

t 0 = (N-l)T+x v 

By applying Eq. (16.9), we obtain the following expression for the 
frequency response of the optimum filter: 

Kept (AD) = BS$e- jan ’( 1 + e jmT + e j2(oT + ... + 

= Ko.opt (Ad) (1 + e ~ jmT + e j2wT +...;+ e 1)<nT ) 

(16.21) 

where K 0 opt (j(o) is the frequency response of the optimum filter for 
a single video pulse. 

The structure of the sought matched filter results directly from 
Eq. (16.21). In block-diagram form, it appears in Fig. 16.4. As is 
seen, a matched filter for a single video pulse is located at the input. 



Fig. 16.4 Matched filter for a train of video pulses 


(W-l)T 
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The basis of the entire device is a multi-tap delay line which delays 
the signals for T, 2 T, ..., and (JV-l)T. From all the taps, the 
signals go to the adder. It is an easy matter to see that the response 
at the adder output will be a maximum when the signals from all 
the pulses in the train are present at its inputs simultaneously. 

Thus, the above matched filter “compresses” the train by deriving 
a single response of a maximum amplitude from the entire sequence 
of pulses making up the train. The performance of the device 
improves with increasing length of the train. 

Practical radar detectors also include a nonlinear threshold 
element whose input is connected to the output of the adder in the 
matched filter. The threshold level somewhat exceeds the 
root-mean-square level of noise in the no-signal condition. When 
the maximum spike of the filter output signal reaches the threshold 
level, a control signal is routed to the display unit, thereby 
indicating the presence of the pulses reflected from a target. 

The matched filter for a rectangular radio pulse. Let the signal 
being detected be a rectangular radio pulse such that 

To, t < 0 

Sin (*) = < v 0 sin (Dot, 0 t < Tp (1 6 ' 22) 

! 0, t > Tp 

We set out to synthesize a filter matched to such a signal 
by using our knowledge about the impulse response of the filter. 
As has been shown earlier, the impulse response of a matched 
filter is 

h(t) = Bsi n (t 0 — t ) 


Let us put, as before, t 0 = T p , and. deem for simplicity that the pulse 
duration is a multiple of the period of the r.f. carrier and so 
sinco 0 Tp=0, and cosco 0 Tp=l. Then, 


h(t)=< 


0, t< 0 

B sin co 0 t, 0 ^ t < Tp 

0, t > Tp 


(16.23) 


As is seen, the impulse response of a matched filter replicates the 
input signal to within the amplitude factor. This impulse response 
can be approximately realized with the structure shown in 
block-diagram form in Fig. 16.5. 

As is seen, at the filter input there is an oscillatory element, such 
as a high-Q resonant circuit whose impulse response is 


f 0, t < 0 

| H sin co 0 t, t > 0 


The use of complex 
signals in the form of 
trains will naturally 
slow down the rate of 
data output as compar¬ 
ed with single pulses 


If the oscillatory ele¬ 
ment has a high Q, 
the exponential decay 
of the amplitude with 
time may be neglected 


where H is a constant. 
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Barker sequences may 
be of length M = 2, 
3, 4, 5, 7, 11, 13 bits 



Fig. 16.5 Matched filter for a rectangular radio pulse 

For the impulse response of the matched filter to be zero at t > 
> x p , the filter includes an adder one input of which receives the 
signal from the oscillatory element directly, and the other does so 
via a delay unit which delays the signal for x p . Connected in series 
with the delay unit is a phase shifter which reverses the phase of the 
signal. With this arrangement, the adder inputs receive, beginning 
at t = T p , two harmonic waves which have the same amplitude, but 
are opposite in phase. The result is a zero signal at the adder 
output. 

The matched filter for Barker sequences. A matched filter can be 
far more effective in signal compression, if the input consists of 
Barker sequences instead of simple trains of pulses. As. is pointed 
out in Chap. 3, an advantage of Barker sequences is that the main 
lobe of the autocorrelation function has a very high value, whereas 
the side lobes are minimal. 

A block diagram of a matched filter for M-digit Barker sequences 
is shown in Fig. 16.6. The filter utilizes the principle of phase-shift¬ 
keying in which, as will be recalled, the input signal consists of 
a sequence of chopped harmonic waves whose phase angles cp 1? cp 2 , 
..., cpM are either zero or 180° (see Fig. 3.7). 

In synthesizing this form of matched filter, we proceed from the 



Fig. 16.6 Matched filter for a Barker sequence 
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fact that its impulse response must be a “mirror image of the 
detected signal, with its elements following in a reverse time order. 

At the input of the matched filter there is an auxiliary filter F 1 
matched to one element of the complex PSK signal, that is, to 
a rectangular radio pulse. Under the action of the input 
delta-impulse, the filter output delivers a radio pulse with 
a rectangular envelope. This pulse is applied to a tapped delay line 
which usually is a distributed-parameter (wave) structure. The delay 
time between the taps is equal to the duration T of each element of 

the complex signal. , 

For the matched filter to operate properly, it is essential that the 
sequence of phase angles cp m, <Pm-i> •••» <Pi (Fig. 16.6) should 
correspond to the phase angles of the individual pulses of the 
Barker sequence as counted backwards. 

Travelling along the delay line, the rectangular radio pulse 
consecutively excites the inputs of the adder, and this delivers 
a “mirror image” of the signal being detected. 

The matched filter for LFM-pulses. Equation (16.17) tells us that 
the limiting value of the signal-to-noise ratio at the output ol 
a matched filter depends on the energy in the signal, whatever its 
waveform may be. In practice, however, the task is usually not only 
to detect the presence of a signal, but also to measure some 
parameters of the signal, say its time position. In such cases, 
preference is given to signals whose autocorrelation function has 

a sharp maximum (see Chap. 3). 

Among the several signals possessing this property, those 
especially widely used are linearly frequency-modulated (LFM) 
pulses. Their theory is set forth in Chap. 4. It has been shown that 
if an LFM pulse of the form ^ 

( 0 , t<- t p /2 

Sin (t) = \ v 0 cos (coot + pt 2 /2), - T P /2 < t < Xp/2 

(o, *> V 2 

has a large bandwidth-duration product, pip»1, then its 
spectrum S in (co) = I Sin I exp [/<!>(©)] within the bandwidth Aco = px p 
has a practically constant magnitude 

| S in I = Vo ]/TC/2pt 


▲ 

Solve Problem 3 


and the argument is a quadratic function of frequency: 

<f> (co) = - (to - co 0 ) 2 /2|r (16.24) 

Hence comes the requirements that should be satisfied by the 
frequency characteristic of the filter matched to an LFM-signa . 
For the output response to be a maximum at some time t 0 , it is 
essential that the amplitude response of the filter should be 
constant in the frequency interval (co 0 - Aco/2, co 0 + Aco/2) and that 
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The phase response of 
the matched filter for 
an LFM signal 


▲ 

Solve Problem 4 


its phase response should be 


<PK (ra) = - (Ot 0 + (<o - co 0 ) 2 /2n ( 1 6.25) 


The first term on the right-hand side of Eq. (16.25) is responsible 
for the delay of the output signal as a whole for a time t 0 , the 
second (quadratic) term compensates for the phase shifts between 
the individual components of the signal and thus assures that they 
are combined coherently at the output. 

The quadratic character of the phase response of the matched 
filter for an LFM signal can be deduced from the following 
qualitative considerations. In the course of the intrapulse 
modulation the instantaneous frequency of the signal varies linearly 
as 

cn(f) = co 0 + pf 

in the time interval (- x p /2, x p /2). To each time t within the pulse 
duration there corresponds its own narrowband (quasiharmonic) 
signal which is delayed by the filter for the time interval equal to 
the group (envelope) delay time (see Chap. 8): 

T s= ~ d<PK/dco = t 0 - (to - oo 0 )/n =t 0 -t (16.26) 

In order to find the instant when the individual spectral 
components appear at the output, we should add to the above time 
the amount t, that is, the time when the spectral components 
appear at the input. Hence we conclude that all the spectral 
components of the LFM signal appear at the filter output at the 
same time t 0 . 

The signal appearing at the output of the matched filter replicates 
to within an arbitrary amplitude factor A the autocorrelation 
function of the LFM pulse (see Eqs. (4.54) and (16.15)): 

sin ~(t~ t 0 ) 

5 out = A — -cos fo 0 (t - t 0 ) (l 6.27) 


A plot of the above signal has been given in Fig. 4.10. It is easy to 
see that the width of the main lobe of such a signal, as measured 
between zero points, is equal to 

Tout = 471 /AcO = 471/pip 

Therefore the compression ratio of an LFM pulse provided by the 
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matched filter 


bandwid th x duration 
Kcomp = V T out = F x p /4ft — 4^ 


(16.28) The compression ratio 
for a pulse 


is directly proportional to the bandwidth-duration product of the 

LFM signal. . 

In constructing actual matched filters, advantage is taken ol 
a physical phenomenon consisting in that elastic ultrasonic waves De i ay ii nes are often 
propagating in solids display what is known as dispersion, that is, ma de of aluminium 
variations in the velocity of propagation with frequency. Through a H oys 
the proper choice of the form of dispersion, it is possible to secure 
that the phase response has the form defined in Eq. (16.24). In 
sketch form, the arrangement of such a filter is shown in Fig. 16.7. 



iu 0 

(b) 


Fig. 16.7 Distributed-parameter filter matched to an LEM signal: (a) 
sketch; (b) frequency dependence of group delay in the acoustic line; (I) 
acoustic line; (2) electromechanical transducers 

In contrast to the optimum filtering of trains of video pulses, the 
matched filtering of LFM pulses is usually effected at the carrier 
frequency or the intermediate frequency of the receiver, that is, 
ahead of the amplitude detector. This avoids the undesirable 
suppression of a weak signal by a strong interference which may 
arise when the sum of the signal and noise is subjected to nonlinear 

transformation. . . . u 

Quasi-optimum filters. In some cases, a known signal mixed with 
a Gaussian noise can be detected with sufficient effectiveness, using 
filters far simpler in design than optimum filters.. They are 
customarily called quasi-optimum filters. 

Consider an integrating RC two-port whose input simultaneously 
receives white noise of power spectrum W 0 and a rectangular video 
pulse of amplitude V 0 and duration x p . Since the two-port is 
a linear network, the passage of the signal may be considered 
separately from that of the noise. 

The output signal is a maximum at the instant when the pulse 


An advantage of signal 
processing ahead of the 
detector 
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The theory of quasi- 
optimal signal filtering 
has been developed by 
V. I. Siforov (USSR) 
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ceases, and is equal to 
Sout, max = Vo [1 — ex P ( — 

On the other hand, the variance of the output noise of the 
RC-network driven by white noise is defined (see Chap. 10) by 

v 2 out= WJ2RC 


Hence, the maximum signal-to-noise ratio at the output of the 
RC-network is 


VoV 

Qrc — 


- exp (- x p i?C)] 

]/w 0 /2RC 


(16.29) 


Noting that the energy in the video pulse in question is E s = 
= Foip, we may re-write (16.29) as follows: 


q RC = ]/EJW 0 


1 - exp ( - Tp/KC) 
l/xp/2 RC 


(16.30) 


The first factor on the right-hand side is the signal-to-noise ratio 
realized by the filter. The factor in the square brackets represents 
the degradation in the signal-to-noise ratio suffered by the RC-filter 
as compared with a true optimum filter. 

On introducing a dimensionless parameter x = x p /RC, let us 
consider the function representing the above factor: 


k(x) = 


1 — exp ( — x) 

|/x/2 


(16.31) 


Its plot appears in Fig. 16.8. As is seen, at x = 1.25, k(x) is at 
a maximum equal to 0.90. 


The principal require¬ 
ment for a quasi-opti- 
mal filter is to pass 
without attenuation the 
frequencies where the 
bulk of signal energy 
is concentrated 


k 



Fig. 16.8 Impairment in the signal-to-noise ratio of an RC filter in 
comparison with a matched filter 
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Thus, through the proper choice of the time constant for the 
RC-network, it is possible to build a very simple quasi-optimum 
filter for which the signal-to-noise ratio is only 10/ lower than it 
for a matched filter. 

It should be noted that quasi-optimum filters of acceptable 
performance can be built only for relatively simple signals with 
a small bandwidth-duration product. 


16.3 Optimum Filtering of Random Signals 

In practice it is usual that the exact form of the signal is not 
known in advance. Examples are the real signals sent into die 
communication channel from sources such as a microphone, a TV 
camera etc. In such cases, the instantaneous values of the signal 
should be treated as typical realizations of a stationary ergodic 
ensemble, and the sole information about the entire set of lik y 
signals is contained in the power spectrum (or the autocorrelation 

function) of this random process. 

In the channel, the signal is accompanied by noise. As a rule, the 
power spectra of the signal and of the noise differ to a varying 
degree in their position along the frequency axis. This difference can 
be utilized in order to formulate and solve the problem which has 
as its objective to develop a stationary linear filter which could 
detect the signal in the best possible manner. 

The statement of the problem and the criterion of optimality. 

Suppose that the input of a filter whose frequency response is K(j o>) 
fsTd^imultaneously two random signals whose reahzabons are 
x(t) and z(t). Let x(t) be the wanted signal, and z(t) be the notsse. 
Both are realizations of two stationary random processes, X(t) and 
Z (t), respectively. It is presumed that these two random process 
are uncorrelated and are defined by their power spectra, W x ( co) and 

W (col 

The realization y(t) of the output signal of the filter is not an 
exact replica of the input signal x(t), but differs from it by an 
amount known as the random error 


e(t) = x(t) — y(t) 


(16.32) 


The optimum filter is then taken as that for which the error 

variance is a minimum. ( * . 

Relation of the error variance to the power spectrum. If W e ( a>) is 

the power spectrum of the error, then its variance is 


1 

2n 


W4(co)do) 


(16.33) 


Let us relate IL e M to W x (v) and For this purpose, we will 


This type of filter is 
said to minimize the 
mean squared error of 
signal reproduction 
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Fig. 16.9 Explaining the derivation of the error signal 


consider the block diagram of an imaginary device whose output is 
the realization of the error, e(t), (Fig. 16.9). 

Since, by the statement of the problem, the processes X(t) and 
Z (t) are uncorrelated, the powers of the random signals reaching 
the output over each of the two available channels are combined, 
and so 

W e ((o) = I K (/co) | 2 fF,((o) + 11 - K(ja)\ 2 W x ((n) (16.34) 

Let us write the frequency response of the filter in exponential 
form: 

K (/co) = H k (<n) expjcpx (co) 

and investigate the term |1 - K(j(o)\ 2 on the right-hand side of 
Eq. (16.34). Obviously, 

|1 -K(j<o)\ 2 =H 2 k -2H k cos<p K + 1 


The condition imposed 
on the phase response 
of an optimum filter 


The theory of optimum 
filtering as applied 
to random signals was 
developed by A. N. 
Kolmogorov and N. 
Wiener in the 1940s 


this quantity being a minimum when cp K = 0. Thus, the optimum 
filter in question should introduce a zero phase shift at all 
frequencies. 

Noting this, we obtain the following expression for the error 
variance: 

OO 

(% 

\_{H k - X ) 2 W x + H\W z -\&u (16.35) 

0 

Minimization of the error variance. By carrying out simple 
identity transformations, it is convenient to write Eq. (16.35) as 



Gi = 


1 

2 n 


1 /Wx+WzH k -- 


fV x 


+ - 


w x w z 


\/w x +W z ) Wx+W z 


dco 


(16.36) 


The magnitude of the frequency response, H (co), appears only in 
the integrand term within the parentheses. This term is nonnegative, 
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therefore the error variance is a minimum when 

W x (a>) 


yw x +w z H k - 


yw x +w z 


= 0 


Hence, 


H kf opt(®) — 


W x 


W x ((o) + FFz(co) 


(16.37) 


Equation (16.37) not only solves the problem stated, but also 
makes it possible to find on the basis of Eq. (16.36) the minimum 
error variance: 


00 


G e, min — 



— OO 


WxW z 

w x +w z 


dco 


(16.38) 


or, on passing from W x and W z to the one-sided power spectra F x 
and F z , 


2 

& e, min = 


F x + F z 


d f 


(16.39) 


The meaning of the above results is simple: The amplitude 
response of an optimum filter which minimizes the 
root-mean-square error must be large at the frequencies where the 
bulk of the signal energy is concentrated. Conversely, it must 
decrease where the power spectrum of the error is high. 


Physical interpretation 
of the frequency pro¬ 
perties of an optimum 
filter 



Example 16.2. A random process X (t) (the wanted signal) has 
a band-limited one-sided power spectrum F x equal to 5 x 10 6 
V 2 Hz “ 1 in the frequency band from 1 to 3 kHz and zero elsewhere. 
The random process Z(t) (the noise) has a one-sided power spectrum 
showing a similar frequency dependence: F z = 2.5 x 10 6 V 2 Hz 
in the frequency band from 2 to 4 kHz. Find the frequency response of 
the optimum filter and the minimum root-mean-square error in the 
signal reproduced. 

Taking advantage of Eq. (16.37), we find that the amplitude 
response of the optimum filter must be nonzero only in the fre¬ 
quency interval 1-3 kHz where the power spectrum of the detected 


1, 1 kHz </< 2 kHz 

0,66, 2 kHz </< 3 kHz 


Hk, op t(/) = 
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Part Two. Circuits 


The signal variance equal to the product of the power spectrum 
by the frequency band occupied, is 

g 2 x = 5 x 10" 6 x 2 x 10 3 = 10" 2 V 2 
On the other hand, from Eq. (16.39) we get 
12 5 x 10 “ 12 

gi,min= 75xl0 —6 x 10 3 = 1.66 X 10 -3 V 2 


LOO 

0.66 


1 k,opt 


n 


2 3 


i /, kHz 

4 


To sum up, when the two above random processes are subjected 
to linear filtering, the root-mean-square error in the signal 
reproduced will be at least 16.6%. 


Summary 

<0*0* A matched filter intended to detect a known signal mixed with Gaussian white noise 
at a maximum signal-to-noise ratio must have a frequency response proportional to 
the complex conjugate spectrum of the signal. 

OO The impulse response of a matched filter is a “mirror image” of the detected signal. 

O0 The response of a matched filter to the signal being detected is proportional to the 
time-shifted autocorrelation function of the signal. 

OO The maximum attainable signal-to-noise ratio at the output of a linear filter depends 
only on the signal energy and the power spectrum of the noise. 

00 Satisfactory results in the detection of simple signals can be obtained by using quasi¬ 
optimum filters instead of matched filters. 

OO For a linear filter to detect a random signal with a minimum root-mean-square error, 
its amplitude response must be a maximum in the frequency band where the power 
spectrum of the signal is high, and it must be a minimum where the power spectrum 
of the noise is high. 


Review Questions 

1. What is the difference between the criterion of optimality for filters used for the detection 
of known and unknown signals? 

2. Explain the principle of coherent addition of spectral components in the case of matched 
linear filtering. What is the difference between the comb filter and the matched filter? 

3. State the condition for the delay time t 0 when a known signal is detected by an optimum 
filter. 

4. What autocorrelation function of a signal should be like so that a matched filter could 
detect it effectively? 

5. What principle underlies the construction of real matched filters for LFM pulses? 

6. What is the relation of the minimum error variance to the power spectra of the signal 
and of the noise in the optimum filtering of a random signal? 
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Problems 

1. Plot the impulse response of the filter 
matched to the triangular input signal 
shown below: _ 


0 Tp 

Give the minimum value of delay time t 0 . 

2. A resistor R = 500 Q held at T — 300 K 
acts as an equivalent source of white noise 
at the input of a filter. What should the 
resultant signal energy be for the matched 
filter to give a signal-to-noise ratio of q = 5? 

3. A PSK Barker sequence consists of 13 
pulses, each pulse being 10 pV in amplitude 
and 5 ps in duration. Find the power 
spectrum of the input white noise at which 
the output signal-to-noise ratio is unity. 

4. There is an LFM pulse with 
a rectangular envelope, a frequency 
deviation of Aco = 3 x 10 7 s “ 1 and 
a duration of x p = 3.5 x 10 “ 5 s. Find the 
duration of the main lobe of the wave at the 
output of the filter matched to this signal. 


5. The signal is a realization of a random 
process X(t) for which the one-sided power 
spectrum is F x = 8 x 10 “ 5 V 2 Hz " 1 in the 
frequency band 0 </< 300 Hz, and zero 
elsewhere. This signal is combined with 
white noise, Z(t\ whose one-sided power 
spectrum is F z — 2 x 10“ 6 V 2 Hz“ 1 at all 
frequencies. Find the error variance in the 
signal detected by an optimum filter. 

Advanced Problems 

6. Draw a block diagram for the matched 
filter intended for the optimum detection of 
a triangular signal (see Problem 1). 

7. Contemplate the possibility of reducing 
the side lobes of the autocorrelation 
function of an LFM signal by using time 
variations in frequency more complex than 
linear. 

8. Derive an equation defining the fre¬ 
quency response of an optimum filter which 
can predict the instantaneous values of the 
signal x (t + 1 0 \ that is, extrapolate some 
“future” values of the signal in the best 
possible manner (in the mean-square sense). 
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Appendices 


Appendix 1 Walsh Functions and Some 
of Their Properties 

At present, several methods are in use for determining Walsh 
functions [22]. The most convenient way is one based on the 
recurrence relation 

wal(2n + p,9) = (- l) [ " /2)+p [wal(n,29 + 1/2) 

+ (-l) n + p wal(n, 29-1/2)], n = 0, 1,2, ... (Al.l) 


Here [n/2] stands for the largest integer number, which is smaller 
than or equal to n/2; the number p may take on values 0 or 1. 

In carrying out iterations, it should be remembered that the 
function wal (0,9) is constant over the interval - 1/2 < 9 < 1/2: 


0 , 9 < - 1/2 


wal (0,9) = 


< 1, — 1/2 < 9 < 1/2 

0 , 9 > 1/2 


(Al-2) 


For example, on setting n = 0 and p=l, we obtain from (Al.l) 
wal (1,9) = - wal (0,29 -F 1/2) — wal (0,29 - 1 /2) 


The Walsh functions have an interesting property: 
wal (m, 9) wal (n, 9) = wal (1,9) (A 1.3) 


where the index / is the modulo 2 sum of the indexes w and 
n (symbolized as l = m@n). In order to take a modulo 2 sum, the 
numbers m and n must be expressed in binary notation; then the 
binary numbers are added together without a carry to the next 
more significant bit position by the following rule: 


1 © 0 = 0 ® 1=1 


(A 1.4) 


0 ® 0 = 1 © 1=0 

For example, if m = 5 (dec.) = 101 (binary) and n = 6 (dec.) = 110 
(binary), then 1010110 = 011 (binary) = 3 (dec.). Thus, 

wal (5, 9) wal (6, 9) = wal (3, 9) 

In the literature on the subject, in addition to the Walsh 
functions, use is often made of two more related systems, namely 
the even functions cal ( n, 9) (similar to cosines) and the odd 
fucntions sal ( n , 9) (similar to sines). The three classes of functions 
are related in the following manner: 

cal (n, 9) = wal (2n, 9) 


sal(n, 9) = wal(2n -1,9) 


(A1.5) 
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Appendix 2 Berg Functions y 0 (9), Yi(^), and y 2 (9) 



Yo 

Yi 

Y 2 

0 

0 

0.000 

0.000 

10 

0.000 

0.001 

0.001 

20 

0.004 

0.009 

0.008 

30 

0.015 

0.029 

0.027 

40 

0.034 

0.066 

0.056 

50 

0.065 

0.121 

0.095 

60 

0.109 

0.196 

0.138 

70 

0.166 

0.287 

0.176 

80 

0.236 

0.390 

0.203 

90 

0.318 

0.500 

0.212 

100 

0.410 

0.611 

0.203 

110 

0.509 

0.713 

0.176 

120 

0.609 

0.805 

0.138 

130 

0.708 

0.878 

0.095 

140 

0.800 

0.934 

0.056 

150 

0.881 

0.971 

0.027 

160 

0.944 

0.991 

0.008 

170 

0.985 

0.999 

0.001 

180 

1.000 

1.000 

0.000 


Appendix 3 The Subroutine for the Computation of 
Berg Functions 

SUBROUTINE BERG (N, T, G) 

PI = 3.1415926 
A = N 

IF(N. EQ. 0) GOTO 1 
IF(N. EQ. 1) GOTO 2 
G = 2. * (SIN (A * T) * COS (T) — A * COS 
* (A * T) * SIN (T)/(PI * A * (A * A - 1.)) 

RETURN 

1 G = (SIN (T) — T * COS (T))/PI 
RETURN 

2 G = (T - SIN (T) * COS (T))/PI 
RETURN 

END 

This subroutine is called out with the CALL BERG (a, [3, y) 
statement. Here a and |3 are the actual values of the harmonic 
number n and the cutoff angle 9, respectively. The computed values 
of the function y„(9) are stored in the “y” memory location. 
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Appendices 


Appendix 4 Laplace Transform Pairs 


F(P) 


m 


i/p. 

i/p 2 

l/(p + a) 
p/Cp + a) 
a/[p (p + a)} 

\/(p + a)(p + b) 

p/(p+a)(p + b) 

l/(p + a) 2 
p/iP + a) 2 

®/(P, + “) 
p/(p + co 2 ) 
co/[(p + a) 2 +w 2 ] 

(P + «)/[(P + fl ) 2 + <° 2 ] 
P/(P - a 2 ) 


8 (t) 
a(t) 
t 

exp (— at) 

5 (0 — a exp (— at) 

1 — exp (— at) 

—— (e- a '-e- fc( ) 
b — a 

—— (be^'-ae-") 
b - a 
te~ at 

(1 -at)Q~ at 
sin cot 
coscot 
e~ at sin cot 
e~ at coscot 
cosh at 


a 2 /p 2 (p + a) 

1 

p(p + a)(p + 8) 


at — (1 
1 


ah 


1 +- 


• e _a ‘) 
1 

a — 


-(he - 


ac- h ’)] 


1 

1 

P C(p + a) 2 + co 2 ] 

a 2 + co 2 

1 

1 

(p + a ) (p 2 + CO 2 ) 

a 2 + co 2 

p 

1 

(p + a)(p 2 + co 2 ) 

a 2 + co 2 

P 2 

1 

(p + fl ) (p 2 + CO 2 ) 

a 2 + co 2 


ri — e a( (coscot + — sincot)l 
co 

( e“ at — coscot H-sin co t) 

co 

(— ae - + a cos co t + co sin co t) 
(a 2 e“ at — aco sin co t + co 2 cos cot) 
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Appendix 5 The Subroutine for the Computation 
of Discrete Fourier Coefficients 

SUBROUTINE TRFUR (X, A, B, N, G) 

DIMENSION X(N), A(N), B(N) 

G = 0. 

A1 =0. 

AN = N 
DOII = 1,N 
G = G + X (I) 

1 

A1 = A1 “)"( — l.)**I*X (I) 

G = G/AN 
A(N/2) = Al/AN 
M = N/2 — 1 
D02I = 1,M 
AI = I 
A (I) = 0. 

B(I) = 0. 

D03J = 1,N 
AJ = J 

T = 6.283185 * AI * AJ/AN 
C = COS (T) 

S = SIN (T) 

A (I) = A (I) + X (J) * C 
A(I) = A(I) + X (J) * C 
3 B (I) = B (I) + X (J) * S 

A(I) = A(I)*2./AN 
2 B(I)= B(I)*2./AN 

RETURN 
END 

The arguments of the above array are as follows: X, the real 
array of numbers being processed; A and B, the arrays of real and 
imaginary parts of the discrete Fourier transform, respectively; N, 
the length of the input array; G, the name of the variable 
corresponding to the constant component of the discrete Fourier 
transform. Some of the memory locations assigned to arrays A and 
B remain vacant, which is permitted if the length of the array being 
processed does not exceed several tens of samples. 
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Chebyshev approximation, 395, 399 
Chebyshev polynomials, 399 
Circuit analysis, 380 
Circuit synthesis, 380 
Circuit theory, 380 
Circuits, 13 

parametric, 345 
response of, 345 
zero memory, 345 
with feedback, 409 
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amplitude, 92 
phase, 92 
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Comb filter, 489 

amplitude response of, 489 
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Complex input impedance, 261 
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Correlation analysis, 78, 84 
Correlation coefficient, 172, 180, 297 
Correlation detector, 183 
Correlation time, 90, 91, 194 
Correlator, 183 
Covariance, 172 
Co variant moment, 172 
Cross-correlation, 183 
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Cross-power spectrum, 80 
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Decay time, 18 
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group, 285 

Delayed feedback, 414 
Delta correlation, 190 
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filtering properties of, 25 
Laplace transform of, 71, 254 
spectrum of, 56 
Demodulation, 13 
Demodulator, 147 
synchronous, 351 
Depth of modulation, 104 
Detection, 13 

AM signals, 330 
linear, 334 
square-law, 334 
synchronous, 350 
Detector, 

diode AM, 335 
envelope, 335 
linear, 335 
synchronous, 351 
Differentiating networks, 244 
Digital filtering, 448 
algorithms, 468 
Digital filters, 462 

canonic form of, 474 
effect of quantization on, 482 
frequency response of, 466, 471 
implementation of, 466 
impulse response of, 465, 470 
linear stationary, 462 
order of, 469 
recursive, 472 
signal quantization in, 463 
stability of, 474 
synthesis of, 477, 479 
system function of, 467 
transversal, 469 
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Discrete signals, 448 

cross-correlation function of, 99 
Distribution, 
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Poisson, 304 
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Rice, 214 
uniform, 166 

Distribution function, 164 
Down-converter, 361 
Driving function, 222 
Driving-point admittance, 259 
Driving-point immitance, 385 
Driving-point impedance, 261, 380, 391 
real and imaginary parts, 383 
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Dynamic transconductance, 315 
Dynamic transfer characteristic, 324 


Eigenfunction, 227 

Eigenvalue, 227 

Energy density, 82 

Envelope, 18 

Envelope delay, 285 

Equal-ripple approximation, 395, 399 

Ergodicity, 181 

Estimate, 

empirical, 163 
sample, 163 
Excitation, 222 
Expectation, 165, 179 
Expected value, 165 
Exponential approximation, 318 


Fall time, 18 

Fast Fourier transform, 457 
Feedback, 

degenerative, 410 
delayed, 414 
internal, 432 


negative, 410 
positive, 410 
in tuned amplifier, 413 
regenerative, 410 
Feedback element, 409 
Feedback networks, 415 
Filter synthesis, 420 
Filtering, 
digital, 448 
optimal, 487 
random signals, 501 
Filters, 

active RC , 420 
Butterworth, 396 
comb, 489 
digital, 448, 462 
frequency, 80 
Gaussian radio, 267 
high-pass, 81 
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ideal low-pass, 230 
ideal quadratic, 152 
implementation of, 401 
low-pass, 134, 423 
matched, 488 
maximally flat, 396 
optimum, 487 
order of, 396 
prototype, 406 
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Fluctuations, 162 
Forcing function, 222 
Forward-path element, 409 
Foster type networks, 387 
Foster’s theorem, 385 
Fourier integral, 240 
Fourier series, 42, 453 
generalized, 33 
Fourier transform, 49, 50 
basic properties of, 57 
discrete, 453 
inverse, 456 
fast, 457 
inverse, 51 
discrete, 456 

of impulse response, 371 
relation to Laplace transform, 69 
relation to z-transform, 461 
Frequency, 
complex, 67 
cutoff, 238, 395 
fundamental, 43 
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idler, 361 

instantaneous, 114 
intermediate, 348 
negative, 47 
reference, 143 
resonance, 369 
Frequency changer, 348 
Frequency conversion, 348 
Frequency converter, 348 

Frequency deviation-pulse duration product, 126 
Frequency division multiplexing, 111 
Frequency filter, 80 
Frequency limit, 238 
Frequency modulation, 114 
Frequency multiplier, 325 
Frequency response, 227, 235, 240 
compensation of, 412 
digital filters, 466, 471 
isolation networks, 401 
multistage system, 242 
nonstationary dynamic system, 170 
parallel resonant circuit, 261 
parametric network, 371 
relation to impulse response, 228 
series resonant circuit, 259 
Frequency response function, 261 
Frequency transformation, 405 
Function, 

autocorrelation, 85, 179 
autocovariance, 179 
characteristic, 169 
complementary, 233 ^ 

cross-correlation, 96 
delta, 23, 223 
spectrum of, 56 
Dirac delta, 23 
distribution, 164 
driving, 222 
forcing, 222 

frequency response, 261 
Green, 223 
Heaviside, 21, 71 
moment, 179 
positive real (p. r.), 382 
rational, 235 
response, 228 
step, 23 
switching, 21 
spectrum of, 64 
system, 228 
transfer, 249 
unit impulse, 23 


voltage-ratio transfer, 391 
Functions, 

Berg, 507 
Walsh, 34, 506 
Fundamental frequency, 43 


Gain, 

closed-loop, 410 
negative, 243 

overall with feedback, 410 
Gain factor, 237 
Gain stabilization, 411 
Gaussian distribution, 166 
Gaussian radio filter, 267 
Green function, 223 
Group delay, 285 
Gyrators, 425 


Harmonic suppression, 411 
Harmonics, 43 
HEAVISIDE, O, 249 
Heaviside function, 21 

Laplace transform of, 71 
High-pass filter, 81 
Hilbert integral transform pair, 383 
Hilbert space, 31 
real, 31 

Hilbert transform, 149, 152 
Hilbert transform pair, 153 
Hurwitz polynomials, 416 


Ideal bandpass filter, 267 
Ideal integrator, 200 
Ideal low-pass filter, 230 
Ideal quadratic filter, 152 
Idler circuit, 361 
Idler frequency, 361 
Immitance, 

driving-point, 385 
Impedance, 

characteristic, 259 
driving-point, 262, 380, 391 
input, 261 
transfer, 391 

Impulse response, 223, 252 
computation of, 240 
digital filters, 465, 470 
Fourier transform of, 371 
frequency-selective circuits, 268 
matched filter, 490 
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nonstationary dynamic system, 370 
relation to frequency response, 228 
Information, 15 
Information theory, 15 
Instantaneous frequency, 114 
Integral, 

Duhamel superposition, 240 
Fourier, 240 

Integrating networks, 244 
Intermediate frequency, 348 
Intermodulation products, 122, 328 
Internal feedback, 432 
Isolation networks, 401 
Inverse Laplace transform, 69 
Inverse z-transform, 460 

Keying, 108 
on-off, 108 
phase-shift, 280 
Kotelnikov basis, 138 
Kotelnikov series, 138 
Kotelnikov theorem, 137, 455 
KOTELNIKOV V. A., 137 

Ladder networks, 386 
Cauer, 387 

Laplace inversion formula, 250 
Laplace transform, 67, 248 
basic properties of, 71 
delta impulse, 254 
inverse, 69 

relation to Fourier transform, 69 
relation to z-transform, 461 
Laplace transform pairs, 70, 252 
Laser, 432 

Lattice networks, 393 
Law of Equipartition of Energy, 301 
Limit cycles, 443 
Linear circuits, 
synthesis of, 380 
Linear detection, 334 
Linear digital filters, 
synthesis of, 477 
Linear signal space, 26 
Local oscillator, 348 
Loss, 243 

Low-pass filter, 395, 423 


Magnitude response, 229 
Manley-Rowe relations, 364 


Markov processes, 184 
Markovian chain, 185 
Matched filter, 488 

for Barker sequences, 496 
frequency response of, 488, 490 
implementation of, 493 
phase response of, 498 
Mathematic signal model, 15 
Matrix notation, 391 
Maximally flat approximation, 395 
Mean, 165, 179 
Mean square, 165 
Message, 15 
Metric, 29 
Metric space, 29 
Minimum-phase networks, 392 
Mixer, 348 
Modulation, 13, 103 
amplitude, 103, 330 
angle, 112 

double-sideband, 110 
frequency, 114 
phase, 113 
pulse, 448 

pulse-amplitude, 449 
pulse-width, 449 
single-sideband, 111 
Moment functions, 179 
Moments, 165 
central, 166 
correlation, 172 
cross-correlation, 172 
Miltiplexing, 

frequency division, 111 
time division, 19 


Narrowband signals, 143 
Hilbert transform of, 154 
Network functions, 391 
Network synthesis, 386 
by Cauer method, 388 
by continued-fraction expansion, 388 
by ’divide and invert the remainder’ pro¬ 
cess, 388 

by Foster method, 387 
by partial fraction expansion, 387 
Networks, 
active, 409 
active RC, 421 
bridge, 393 
canonic, 390 
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Cauer ladder, 387 
Foster-type, 387 
four-terminal, 314, 391 
isolation, 401 
ladder, 386 
lattice, 393 

minimum-impedance, 383 
minimum-phase, 392 
nonminimum-phase, 392 
with feedback, 409 
Noise, 

antenna, 302 
power spectrum of, 301 
quantization, 483 
quantum, 162 
shot, 304 

signal suppression by, 335 
thermal, 301 
white, 195 

response to, 294 
Noise bandwidth, 298 
Noise immunity, 13 
Nonlinear distortion, 322 
Nonlinear signal transformations, 313 
zero-memory, 313 
Nonlinear tuned amplifier, 323 
Nonminimum-phase networks, 392 
Nonperiodic signals, 49 
Norm of signal, 28 
Nyquist law, 301 
Nyquist locus, 418 
Nyquist stability criterion, 418 « 

One-port, 380 
On-off keying, 108 
Operating angle, 45 
Operational amplifier, 420 
Operational calculus, 249 
Operational method, 248 
Optimum filtering, 
random signals, 501 
Orthogonal signals, 32 
Orthonormal basis, 33, 137 
Oscillators, 426 
Colpits, 430 
Hartley, 428 

large-signal condition, 435 
local, 348 

phase portrait of, 443 
pump, 352 
RC phase-shift, 430 
self-excitation of, 426 


small-signal condition, 426 
steady-state operation, 437 
three-terminal, 428 
tranformer-coupled, 426 


Paley-Wiener criterion, 229 
Parametric amplification, 352, 360 
Parametric amplifier, 358 
double-stage, 361 
Parametric network, 

frequency response of, 371 
Parametric up-conversion, 365 
Parseval’s relation, 79 
Partial fraction expansion method, 387 
Particular integral, 233 
Periodic signals, 42 
digitization of, 453 
spectral diagrams of, 44 
Phase deviation, 113 
Phase modulation, 113, 448 
Phase plane, 442 
Phase plane analysis, 442 
Phase plane method, 442 
Phase portrait, 442 
Phase response, 229 
Phase trajectory, 442 
Piecewise-linear approximation, 316, 319 
Poisson distribution, 304 
Pole-zero diagram, 250 
Pole-zero representation, 250, 263 
Poles, 

location of, 380 
number of, 382 
Positive real function, 382 
Power approximation, 317 
Power density, 82 
Power density spectrum, 82, 191 
Power spectral density, 82, 191 
random processes, 292 
Power spectrum, 81, 190 
noise, 301 
one-sided, 192 
random processes, 292 
random signals, 291 
relation to autocorrelation function, 90 
shot noise, 308 
Probabilistic laws, 162 
Probability, 163 
Probability density, 164 
bivariate, 178 
one-dimensional, 178 
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two-dimensional, 178 
univariate, 178 
Prototype filter, 406 
Pulse, 

amplitude of, 18 
bandwidth of, 56 
duration of, 18 
fall time of, 18 
radio, 18 
spectrum of, 65 
rise time of, 18 
video, 18 

Pulse-amplitude modulation, 449 
Pulse duty factor, 44 
Pulse modulation, 448 
Pulse modulator, 448 
Pulse-width modulation, 449 
Pump oscillator, 352 


Q-factor, 260 
Quadrant symmetry, 395 
Quantization, 

effect on digital filters, 482 
Quantization interval, 464 
Quantization noise, 464, 483 

autocorrelation function of, 483 
Quantized signals, 464 
Quantum noise, 162 


Radiation resistance, 303 
Radio pulse, 18 
spectrum of, 65 
Ramp input, 245 
Random signals, 162 

autocorrelation function of, 291 
broadband, response to, 298 
normalization of, 300 
optimum filtering of, 501 
power spectrum of, 291 
stationary, response to, 337 
Random processes, 177 
correlation theory of, 189 
differentiation of, 196 
effective bandwidth of, 195 
integration of, 196 
Markov, 184 
narrowband, 203 
autocorrelation function of, 203 
power spectrum of, 190 
spectral representation of, 189 


stationary, 179 
Gaussian, 184 
narrow-sense, 180 
power spectrum of, 292 
wide-sense, 180 
Rational function, 235 
RAYLEIGH, Lord, 79 
Rayleigh distribution, 209 
bivariate, 212 
Rayleigh formula, 
generalized, 78 

Rayleigh-Jeans radiation formula, 302 
Recursive digital filters, 472 
Resistance, 
d.c., 314 
dynamic, 315 
incremental, 315 
Resonance curve, 262 
Resonance frequency, 
instantaneous, 369 
Resonant cavity, 222 
Resonant circuit, 

capacitance-tunable, 368 
Response, 

amplitude, 229 
Butterworth, 396 
complex, 228 
free, 233 

frequency, 235, 240 
impulse, 223 
magnitude, 229 
maximally flat, 396 
phase, 229 
transfer, 228 
transient, 233 
Response function, 228 
Rice distribution, 214 
Ripple factor, 399 
Rise time, 18, 278 
Routh-Hurwitz criterion, 416 


Sample, 448 
Sampling, 448 
Sampling interval, 19, 449 
Sampling rate, 451 
Sampling theorem, 137, 455 
Scale changer, 422 
Schematic circuit diagram, 222 
Schottky’s equation, 307 
Secular factors, 233 
SHANNON, C., 15, 143 
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Shot noise, 304 

power spectrum of, 308 
Sideband, 108 
double, 110 
lower, 108 
upper, 108 
Signal energy, 28 
Signal space, 26 
Signal suppression, 335 
Signals, 15 

AM, detection of, 330 
amplitude modulated, 103 
analog, 19 
analytic, 149 
band-limited, 133 
mathematical models of, 133 
orthogonal, 136 

bandwidth-duration product of, 142 

broadband, 268 

classification of, 15 

continuous, 19 

correlation analysis of, 84 

cross-energy of, 31, 78 

deterministic, 17 

digital, 19 

discrete, 19, 448 

autocorrelation function of, 91 
dynamic representation of, 20 
ideal bandpass, 134 
ideal low-pass, 133 
mathematical model of, 16 
modulated, 103 * 

multidimensional, 16 
narrowband, 143 

Hilbert trasform of, 154 
nonintegrable, 62 
nonperiodic, 49 
norm of, 28 
one-dimensional, 16 
orthogonal, 30, 32 
periodic, 42 
digitization of, 453 
power spectra of, 78, 81 
pulsed FM, 122 

quantization in digital filters, 463 

quantized, 464 

random, 17, 162 

sampled, 19 

scalar product of, 31 

spectral representation of, 42 

stochastic, 17 

vector, 17 


Single-sideband modulation, 111 
Singular points, 70 
Small-signal amplifier, 236, 264 
Space, 

completeness of, 37 
Hilbert, 31 

infinite-dimensional, 27 
linear normed, 27 
linear signal, 26 
metric, 29 

Spectral density, 82, 191 
Spectrum, 42, 50 
analytic signal, 151 
complex exponential signal, 63 
delta function, 56 
exponential video pulse, 53 
Gaussian video pulse, 54 
radio pulse, 65 
rectangular video pulse, 53 
switching function, 64 
time-shifted signal, 58 
translation of, 66 
Spectrum analyzer, 273 
Square-law detection, 334 
Standard deviation, 166 
Step function, 23 
Step input, 245 
Step response, 252, 254 
STRUTT, J.W., 79 
Superheterodyne receiver, 349 
Superposition principle, 221, 313 
Switching function, 21 
spectrum of, 64 
Synchronous demodulator, 350 
Synchronous detection, 350 
Synchronous detector, 351 
Synthesis, 

active RC networks, 421 
digital filters, 479 
linear circuits, 380 
linear digital filters, All 
network, 386 
passive one-ports, 385 
reactive one-ports, 387 
System function, 228 
digital filter, 467 
Systems, 219 

autocorrelation characteristic of, 248 
distributed-constant, 222 
dynamic, 230 

frequency response of, 370 
impulse response of, 370 
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nonstation ary, 366 
order of, 231 
stability of, 238 
transient response of, 233 
linear, 221 

lumped-constant, 222 
mathematical models of, 220 
nonlinear, 221 
nonstationary, 220 
operators of, 219 
parametric, 220 
response of, 219 
stationary, 220 
time-variant, 220 
with feedback, 410 

Tapped parallel resonant circuit, 263 
Time constant, 231 
of tuned circuit, 270 
Time division multiplexing, 19 
Time-domain approach, 240 
Transconductance, 
conversion, 349 
dynamic, 315 
fundamental, 436 
Transfer function, 

linear feedback system, 409 
location of poles, 392 
location of zeros, 392 
maximally-flat (Butterworth) filter, 397 
poles of, 250 
RC networks, 424 
system, 249 
two-ports, 392 
zeros of, 250 
Transfer impedance, 391 
Transfer matrix, 391 
Transfer response, 228 
Transform, 

Fourier, 49, 50 
discrete, 453 
inverse, 51 
properties of, 57 
Hilbert, 149, 152, 153 


Laplace, 67, 248 
inverse, 69 
properties of, 71 
z-, 458 

Transmission matrix, 391 
Two-ports, 314, 380 

frequency characteristics of, 391 
transfer function of, 392 


Uniform distribution, 166 
Unit impulse function, 23 
Unit impulse input, 223 
Unit step input, 223 
Up-converter, 361, 365 


Variance, 166 
Varindor, 358 

Voltage-ratio transfer function, 391 
forward, 392 
isolation networks, 401 
reverse, 392 


Walsh functions, 34, 506 
White noise, 195 

autocorrelation function of, 195 
response to, 294 
Wiener-Khinchin theorem, 191 


Zero-crossings, 294 

autocorrelation function, 294 
Zeros, 

location of, 380 
number of, 382 
z-Transform, 458 

of continuous function, 460 

inverse, 460 

properties of, 461 

relation to Fourier transform, 461 

relation to Laplace transform, 461 

of time-shifted signal, 461 













